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Preface 


In Indian universities the emphasis at the undergraduate level has 
been much more on calculus than on linear algebra and matrix theory. 
Today, however, the need for linear algebra and matrix theory as an 
essential part of undergraduate mathematics is recognised. The Bi- 
national Conference in Mathematics Education and Research (June 1973) 
recommended Elementary Linear Algebra as a compulsory course for all 
students at the undergraduate level. It has since been generally agreed 
that before a student begins to specialise in the discipline of his choice— 
whether it be mathematics, science, engineering, social science, or 
management—he must be exposed at least once to both calculus and 
linear algebra; such an exposure will familiarise him with the concepts 
and techniques of continuous mathematics (calculus), and the concepts, 
methods, and logic of modern discrete mathematics (linear algebra). 


This book is the oulcome of a planned effort to teach linear algebra as 
a second course in the mathematics curriculum introduced at the under- 
gtaduate level scveral years ago at Birla Institute of Technology and 
Science (BITS), Pilani The students who take this course have had a 
semester of elementary calculus and analytical geometry. However, a 
knowledge of the fundamental properties of continuous and differentiable 
functions in terms of their addition, scalar multiplication, and multipli- 
cation is sufficient for an understanding of this volume. 


The treatment throughout is rigorous yet lucid. The fact that the 
majority of students who would use this text may not ultimately become 
mathematicians or physicists has not inhibited our development of the 
subject. We strongly believe that present-day users of mathematics, 
instead of being content with a hybrid of mathematical tools and 
gymnastics which merely graze the subject, should delve deep by training 
in concrete matter-of-fact arguments. The conceptual framework ef linear 
algebra and matrix theory provides the most efficient means for this 
training; for, in one sense, matrices and linear equations form a concrete 
foundation, and vector spaces and linear transformations give the flavour 
of the abstract grandeur of modern mathematics. At the same time, as the 
freshmen we are addressing may not have had any grounding in abstract 
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mathematics, we have made a special effort to smoothen their first 
encounter with methods of proof. 

Theorems are proved in full (the end of proof is indicated by ff), except 
in rare cases where they are beyond the scope of the book. In these 
instances the student is suitably instructed. Where certain consequences 
of earlier results are stated as FACTS, the student will find he has been 
sufficiently equipped in advance to prove them himself. The large number 
of worked-out examples which have been woven into the text help the 
student to move back and forth from the concrete to the abstract. The 
sets of problems—numerical, objective, and theoretical —interpolated at the 
end of almost every article are a drill on the text. Answers to the 
numerical problems appear at the end of the book; the objective questions 
which are of the “‘true-false”’ type are intended to help the student in a 
self-assessment of his conceptual understanding of the subject under 
study. 

Chapter 1 deals with sects and functions and gradually introduces the 
language of modern mathematics. A teaclicr may adjust his pace in th's 
chapter to suit the standard of his class. Algebraic structures, such as 
groups, rings, and fields, have been discussed only to the extent needed. 


Chapter 2 provides the concrete geometric structure of 2- and 3-dimen- 
sional vector spaces. It leads the student to the problems of geometry 
through vectors and prepares the ground for Chapter 3 which gets into 
the essence of the subject. Here the theory of vector spaces, and the con- 
cepts of linear dependence and linear independence, dimension and basis 
are treated elaborately. Though infinite-dimensional vector spaces are 
also considered, the emphasis throughout is on finite-dimensional vector 
spaces. 

Chapter 4 aims to familiarise the student with the fundamental pro- 
perties of linear transformations. The rank-nullity theorem and _ its 
consequences are presented in deta'l. The theory developed so far is 
applied to operator equations and, in particular, to differential equations. 
This application discloses that the solution space of the m-th order normal 
homogeneous linear differential equation is an n-dimensional subspace of 
the space of a-times continuously differentiable functions. The further 
application to the theory of ordinary linear differential equations is detail- 
ed in the Appendix. However, we have not attempted to make the 
treatment of differential equations self-contained. 


The elaborate build-up on vector spaccs and linear transformations 
begins to pay dividends in Chapter 5 which starts by establishing the link 
between linear transformations and matrices. In our experience, the 
welter of mathematical detail on matrices in this chapter is easily assimi- 
lated by the student because of the knowledge of linear transformations 
he has gained in Chapter 4. He is thrilled to see that the elementary 
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(apparently trivial) row operations on matrices finally result in the solution 
of linear equations in all their ramifications. Naturally, the chapter ends 
with matrix inversion. 


Now the student is ready for determinants, presented in Chapter 6. 
When he comes to determinant minors and the rank of a mutrix he realises 
the importance of the emphasis in Chapter 3 on the concept of linear 
dependence and linear independence. The theorem giving the connection 
between the rank of a matrix (already defined in Chapter 5 by means of 
independence concepts) and the order of its nonzero minors is the crux of 
the content here. The ease with which it is proved justifies the efforts 
taken in the development of the subject in earlier chapters. Applications 
to linear equations, and a brief account of eigenvalues and eigenvectors of 
matrices, Wronshians, and the cross-product in V, give an idea of what 
determinants can do. 


Chapter 7 gives a glimpse of the theory of orthogonal and unitary 
matrices, similarity transformations and their application to the geometry 
of quadrics. When the student reaches this chapter, he easily recognises 
the connection batween linear algebra and gcometry. 


The student should guard against conceptual errors of three types : 
‘finiie dimension’ versus ‘infinite dimension’; ‘real scalar’ versus “complex 
scalar’; and “non-empty set’ versus ‘empty set’. When in doubt regarding 
hypotheses he should invoke what may be culled an ‘emergency axiom’ : 
The suitable alternative in each relevant pair(s) is included as an additional 
hypothesis. 


The text can be adapted to suit different curricula : as a one-year 
course running three hours a week; as a one-semester course running five 
or six hours a week (as is the practice at BITS); or, by a judicious selec- 
tion of topics, as a onesemester course running three hours a week. It can 
be used during any year at the undergraduate level or as part of a first 
course in linear algebra at the postgraduate level, if no matrix theory has 
been done till then. However, as the topics have been arranged sequen- 
tially, any student who wishes to change the order of topics will need 
guidance. 


We wish to thank Dr. C. R. Mitra (Director, BITS) and others at BITS 
who encouraged our efforts in writing this book under the Course 
Development Scheme and provided all the necessary assistance in dupli- 
cating and class-testing its earlier versions over a period of thrée years. To 
the BITS students—about 1200—of these three years, we are alsé indebted 
for their lively response to our experiments in pedagogy. 

We are grateful to Messrs. G. R. Verma and B. L..Soni who patiently 
typed the several drafts; Mr. A. P. Rastogi who drew the illustrations; and 
the National Book Trust, India, for subsidising the publication of the 
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book. To Mrs. J. Fernandes of East-West Press, our appreciation and 
thanks are due for a thorough editing of the manuseript. 
Our last words of affectionate gratitude are reserved for our wives and 
family members who continually cheered our years of effort at the project. 
We shall welcome all suggestions for improvement of the book. 


V. Krishnamurthy 


Pilani V. P. Mainra 
September 1938 J. L. Arora 


Chapter I 


Sets and Functions 


We shall begin with a discussion on ‘sets’. Immediately, we get into 
the first requirement of mathematics, viz. proper definitions for 
technical terms. A major concern of mathematics is precision not only 
in the calculations of quantitative information, but aljso in the communi- 
cation of thought. This is why importance is given to definitions in 
mathematics. In this book we shall come across a large number of 
definitions. Each definition will introduce a new technical term or a new 
concept in terms.of preceding definitions. The very comprehension 
of a definition may often depend on the logical development of the subject 
up to that point. 

However, the first technical term, namely, ‘set’ will be introduced 
without a precise definition. The reason is obvious: The moment we 
attempt to define ‘set’, we get into words such as ‘collection’ or ‘aggregate’, 
which themselves need to be defined. We have to draw the line some- 
where ! 


ll SETS 


The meaning of ‘set’ is intuitively understood as a well-determined 
collection of objects, called its ‘members’ or ‘elements’. The objects 
(members or elements) are said to ‘belong to’ the set or to be ‘in’ the set. 
Here all the words in quotation marks are taken to be undefined terms. 
To illustrate the meaning of ‘set’, let us consider some examples. 

Example 1.1 The collection of the three boys : Arun, Mohan, and Ram. 
Example 1.2. The collection of the three symbols: A, (J and Q. 
Example 1.3 The collection N of all natural numbers. 

Example 1.4 The collection Z of all integers. , 
Example 1.5 The collection Q of all rational numbers. 

Example 1.6 The collection R of all real numbers. 

Example 1.7 The collection of all the past presidents of India. 


Example 1.8 The collection of all the first year students of Birla Institute 
of Technology and Science (BITS). 
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Example 1.9 The aggregate of the living men in the world whose height 
exceeds 2 metres. 
Example 1.10 The aggregate of the roots of the equation x*? — 1 = 0. 
Example 1.11 The aggregate of the integers that leave a remainder 2 
when divided by 5. 
Example 1.12 The group of cricketers who were out for 99 runs in a 
test match. 
Example 1,13 The collection of all positive primes. 
Example 1.14 The collection of derivatives of all orders of the function 
e*, 
Example 1.15 The collection C of all complex numbers. 


All these are examples of sets. We can construct several such exam- 
pies. Let us now consider two collections which are not sets : 


. (i) The collection of some natura! numbers. 
(it) The collection of the politicians of India. 


In (1) it is not clear which numbers are included in the collection. 
Whether the number 2 is in the collection or not cannot be answered 
without first explaining the word ‘some’. Again, in (1i) the question 
whether a specific person is a politician or not would get different responses 
from different persons. Thus, collections (i) and (ii) are not ‘well deter- 
mined’. 

In contrast to these two examples it is worthwhile to analyse Examples 
1.12 and 1.13. In Example 1.12 we note that every cricketer is either in 
the group or he is not in the group. We do not have to check any records 
to say this. In Example 1.13, again, either a number is a prime or it is not 
a prime. Here it matters little whether it is known that a particular number 
is a prime or not. In other words, it is immaterial whether we can 
answer the question: Is this particular object in the given collection or 
not? What matters for specifying a set is to know unambiguously that 
only one of the two answers is possible : The object in question belongs 
to the given collection or it does not belong to it. 


Thus, we can elaborately describe a set as a collection of objects 
which is well determined in the sense that, for every object, there should 
be only two possibilities available unambiguously : either it belongs or it 
does not belong to the collection. 

If A is a set and x is an element of A, then we write x € A (€ is read 
as “belongs to” or ‘is in’ or ‘is an element of” or ‘is a member of’). The 
negation of this is denoted by x & 4 (& is read as ‘does not belong to’ or 
‘is not in’ or ‘is not an element of” or ‘is not a member of”). 

Justead of such a detailed description of sets, two kinds of symbolic 
descriptions are very often used. One is by listing, if possible, all the 


1.1 sers / 3 


elements of the set within braces, e.g. sets ‘of Examples 1.1 and 1.2 are 
respectively written as 
{Arun, Mohan, Ram} 


and {A, 0,9}. 


The other is by using a dummy element, say x, and writing the character- 
istic properties of x which precisely make it an element of the set. Thus, 
the set of elements characterised by the properties, say P, Q, ..., is written 


as 
{x | x satisfies P, Q, ...} 


or {x : x satisfies P, O, ...}. 
(‘| ° and °:’ are reed as ‘such that’.) Thus, the sets in Examples 1.11 and 
1.12 may respectively be written as 

{x | x is an integer and x = 5k + 2 for some integer k} 


x is a cricketer who was out for just 99 runs 
and : e e 
in a test match 


Note that in the first method the order in which the elements are listed 
is immaterial. Thus, {Arun, Mohan, Ram} and {Mohan, Arun, Ram} are 
the same sets. We shall make this precise by defining the equality of 
sets. 


1.1.1 Definition Two sets A and B are said to be equal if every member of 
A is a member of B, and every member of Bis a member of A. In 
such a case we write A = B. 

For example, {0, 1, 2, 3} = {2,1, 0, 3}. Also Z = {x |x is an in- 
teger} = {..., —3, —2, —1, 0, 1, 2, 3, ...}. 

1.1.2 Convention All our definitions are ‘if and only if’ (iff) statements. 
For example, if a definition reads ‘A triangle is said to be equilateral 
if all its sides are equal’, we actually mean that ‘A triangle is said to 
be equilateral iff all its sides are equal’. 

In: view of this convention, Definition 1.1.1 means that two sets A and 

B are said to be equal iffevery member of A is a member of B, and every 

member of B is a member of A. . 


SUBSETS 


Let A and B be two sets such that every member of 4 is also a member 
of B. Then A is said to be a subset of B. In symbols we write A C B 
(‘C’ is read as ‘is a subset of’ or ‘is contained in’). Whenever A is. a 
subset of B, we also say that Bis a superset of A. In symbols we write 
B= A (‘>’ is read as ‘is a superset of’ or ‘contains’). ° : 
Obviously, every set is a subset (superset) of itself. 
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Exercise Prove that A = BiffAC Band BCA. 

This exercise is immediate and the reader can prove it himself. In 
practice, whenever we want to prove that two sets A and B are equal, we 
prove both the inclusions, i.e. A C Band BC A. 


EMPTY SET 


Consider the set of women presidents of India elected before 
3lst December 1974. There was no such woman president. So this set 
has no members in it. Such a set, i.e. a set containing no elements in it, 
is called an empty set or a null set. It is denoted by 9. 

It may be noted here that there is only one empty set. As a clarifica- 
tion of this, note that the set {x : x is a real number satisfying x* + 1 = 0} 
is also empty and we can write. 

The set of all women presidents of India elected before 

31st December 1974 =@ 

= {x : x is a real number satisfying x? + 1 = O}. 

The set {x : x is a real number satisfying x* + x = 0} consists of only 
one member, namely, zero. So this set can be written as {0}. Note that this 
is not the empty set. 

Nonempty sets that consist of only a single member are called singletons. 
The set in Example 1.14 is a singleton as itconsists of only one element e*. 
It would be interesting (at least for cricket fans) to find out whether the 
set in Example 1.12 is empty or a singleton or has more members than 
one. 

Finally, we note that @ C A for all sets 4. Thus, given a set A, it has 
two extreme subsets. One is A itself and the other is ¢. Any subset 
of A other than A and 9 is called a proper subset of A. 


Problem Set 1.17 


1. Let A, B, and C be three sets such that A C Band B C C. Then prove 
that A C C. 

2. Let S,, S,, ..., S, bem sets such that §, C S, C ... C S, and S, C S§;. 
Then prove that S, = S, = --- = §,. 

3. Prove the exercise given on page 3. 

4. Determine the set of real numbers x satisfying the following : 


(2) 2 <1 (b) x(x + 1) <0 (ey S55 


(J) 2-430 (ce) @+2)(%* —1) 30 (f) pir <x 
5. Determine the set of complex numbers Z satisfying the following : 


@ jei<e wm tite ER <1 


<0 
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(J) zz+2z+27—5 = 0 (ec) zz+ 2274 27°4+5=0., 
6. Determine all the subsets of the set : 
(a) {0, 1, 2} (b) {a, B, y, S}. 
7. Let X be a set containing m elements. What is the total number of 
distinct subsets of ¥ ? 


8. Determine whether each of the following statements is true or false 
(N, Z, Q, and R are defined in Examples 1.3, 1.4, 15, and 1.6, res- 
pectively) : 

(a) NC Q. (b) {N, 2, Z} CR. (c) NC {N}. 
(d) NE {N,Q,Z} (e) RC IN, Q, R}. 

9, Given A = {0, 1, 2,3, 4}, B= {x E N| x < 10}, C = {x € R| x<10}, 
determine whether each of the following statements is true or false : 


(a) ACB. (b) BCC. (c) CCA. 
(d) 1& B. (e) -1€ B. (ff) -lEC, 
(g) 3€ B. (h) CCB. (i) B=C. 


‘1.2 OPERATIONS ON SETS 


The standard operations on sets, which vield new sets from old ones, 
are (i) union, (ii) intersection, and (iii) complementation. 

Given two sets A and B, the union of A and B, written as A U B, is 
defined as 

AUB= {x|x€ Aorxe B. 

Here ‘x € Aor x € B’ means x is in A or in Bor in both. Throughout 
this book the word ‘or’ will be used in the inclusive sense as here, except 
when otherwise stated. 

The intersection of two sets A and B, written as A () B, is defined as 

A(\B = {x|xE€A and x € B}. 

The complement of B in A, written as A \ B, is defined as 

AN B= {x|x EGA and x & B}. 
A \, B is also denoted by Ca(B). 
Example 1.16 Let A = {1, 2,3, 4,5, 6}and B = {0, —1,2, —3, 4, —5, 6}. 
Then 
AW B = {-—S, —3, —1, 0, 1, 2, 3, 4, 5, 6} 
Aft) B == {2, 4, 6} 
AN. B = {1, 3, 5} and B\ A = {0, —1, —3, —5}. 


The geometrical illustrations in Figure 1.1, called Venn diagrams, are 
helpful in understanding these operations. 
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= 


A 


ANB AUB 


The shaded part represents The shaded part represents 
ANB XNA .f AC X 
FiGuRe 1.1 


CARTESIAN PRODUCT 


Let A and B be two sets. Consider the set of all ordered pairs (x, y), 
where x € A and y € B. This set is called the cartesian product of sets 
A and B, written as A x B. In symbols we write 

AXB= {((x,y)|xE Aye B}. 
Example 1.17 Let A = {1,2} and B = {x, y, z}. Then 
AX B= {(1, x), (2, x), (1,9), (2, y), Cl, 2), (2, 2)}. 
Example 1.18 Let R be the set of real numbers. Then R x R (also written 


as R*) is the set of all ordered pairs (x, y), where x and y are real num- 
bers, that is, 


Rx R = {(x, y) | x, y are real numbers} . 


Geometrically, R represents the set of points of a straight line (called 
the real line), and R x R represents the set of points of a plane. 


Problem Set 1.2 


1. Let A, B, and C be the sets as defined in Problem 9 (Problem 
Set 1.1). Determine 


10. 
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(2) AUB (b) ANB (c) AVC 
(d) BUC (e) ANB (ff) BY C 
(zg) C\A (h) A < B. 

Let .4 =- {0,1, 2, 3, 4}, Bz 3x € NI x ~ 20}, 


Cc -tre NIx at. D = {vE MN! x15 divisible by 7}. 
Determine 


{a) AIJB (b} Avs D (c) BC 
(4) BOD fe) Aiic (f) At) D 
(gc) AN B (h) AD GQ BY C 
(y) BND (k CNOD d) AX B. 


If the sets A, B, C, and D are a, defined in Problem 2. then deter- 
mine whether each of the following statements 1s true or false: 


(a) By Coc_D. (b) A. B. (c) ACC. 

(d) AID - 6. (fe) Af CCB (fy) CN ACD. 
Let A — fu. By}, B= {8.0, 0}, C (a, v, e}, Determine 

(a) AX«<R (b) Ax C (c) BKC. 


Describe the following subsets of R 

(a) ivfr> DML f&lx<Q (b) ikl x > HU {x|x<} 
(ec) XP xX  - TW oietx UY WM tel xe—-l n {x|x< 1} 
(fe) {x!'x< -IJf\{xlx> I} (ff fx{[x> WOM te] x SO}. 
If A, B, C, and D are any sets, prove that 

(a) (4 Xx B)M(C x D) = (A (\C) * (BI) D) 

(b) (A x B) D(C X DPC (AUC) x (BUD). 
Give an example in which 

(A x B)U(C xX D)#(A UC) X& (BU D) 

If A, B, and C are any sets, prove that 

(a) AU(BNC) = (AUBN(AUC) 

(b) AN (BUC) = (AN B)U(AN C) 

(c) AU(BUC) = (AUB) UC 

(d) AN(BN C) = (AM BNC. 
Prove DeMorgan’s Theorem : 

If A and B are both subsets of a set S, then 

(a) S\ (A U B) = (S\ A)N (S\ B) 

(b) S\ (4 9 B) = (S\_ 4) U(S\ B). 

True or false ? 

(a) If A and B are two sets, A (1) Bis the largest subset of A U B, 

which is contained in both A and B, 


(b) If A and Bare two sets, 4 U B is the smallest superset of A (1) B, 
which contains both A and B. 
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(c) If A is nonempty, 4 \, B can never be empty. 

(d) The union of two intervals in R is an interval. 

(e) AXxB is not equal to B x A. 

(f) This text has not yet given the definition of an infinite set. 
(g) This text has not yet considered an infinite set. 

(h) R xX Ris the set C of complex numbers. 


1.3 RELATIONS 


Let A be a nonempty set. A subset ® of AXA is called a relation 
on A. If (x, y) € R, we say x is related to y by the relation R and 
symbolically we write x 9 y. For example, R = {(1, 2), (1, 3), (2, 3)} 
defines a relation on the set A = {l, 2, 3}. Herel R2,1R3, 2R3. 
Obviously, it is the usual relation ‘<’, because 1 < 2, | < 3, 2 <3. On the 
same set A, the relation ‘<’ is described by the set {(i, 1), (1, 2), (1, 3), 
(2, 2), (2, 3), (3, 3)}- 

We note that ‘<’, ‘=’, ‘>’, ‘<’, etc., are relations on R, N, Z, and Q. 
‘Is the mother of’, ‘is the brother of’, ‘is married to’ are relations on the set 
of all human beings. 


1.3.1 Definition Let ® be a relation on a set A. 


(a) If x Rx (re. (x, x) E R), for every x € A, RF is said to be a 
reflexive relation. 


(b) If, whenever x 9 y, it 1s also true that y x (i.e. whenever 
(x, y) E R, (y, x) also belongs to R), R is satd to be a symmetric 
relation. 


(c) If, whenever x R y and y F 2, it is also true that x Mz (i.e. if 


(x, y) © Rand (y, z)E RM, then (x, z)E RN), RN is said to be a 
transitive relation. 


(d) A relation on A that is reflexive, symmetric, and transitive is 
called an equivalence relation on A. 
We shall consider several examples of relations. 


Example 1.19 Let A = Z, the set of all integers Consider the subset ® 
of Z xX Z defined by 


R = {(x, y) : x — py is divisible by 3}. 

Here x  y iff (x—y) is divisible by 3. 

(a) 9 is reflexive, because x—yis divisible by 3 for every integer x. 

(b) x—y is divisible by 3 clearly means y—x is also divisible by 3. 
Hence, x  y implies y R x. So R is symmetric. 

(c) If x—y is divisible by 3 and y—z is divisible by 3, it is certainly 
true that x — z = (x — y) + (y — 2) is also divisible by 3. Thus, x y 
and y Rt zimply x ® z. Hence, & is transitive. 
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Therefore, is an equivalence relation. 


Example 1.20 Let A = R, the set of real numbers. It is obvious that ‘=’ 
is an equivalence relation. 
SExample 1.21 Define the relation 9 on Z \, {1} by saying x Ry iff x and 
y have a common factor other than 1. This relation is reflexive and 
syfimetric, but not transitive. 


Example 1.22 On Z, definex R y to mean x > y. This relation is neither 
reflexive nor symmetric, but it is transitive. 


Example 1.23 On Z, define x  y to mean x < y. This is reflexive and 
transitive, but not symmetric. 

Example 1.24 On Z, define x R y to meanx < y + 1. This relation is 
reflexive, but neither symmetric nor transitive. 


Example 1.25 On Z, define x ® y to mean x == — y. This relation is neither 
reflexive nor transitive, but it is symmetric. 


Example 1.26 On the set F of all fractions of the form a/b with a, b ~ 0, 
define a/b R c/d iff b=c. This relation is neither reflexive nor symmet- 
ric nor transitive. \ . 


Example 1.27 Let A be the set {1, 2, 4, 6, ...}. Define the relation 9 by 
saying x Ry iff x and y have a common factor other than 1. This rela- 
tion is symmetric and transitive, but it is not reflexive, because 1 # 1 is not 
true, 


Example 1.28 On C, the set of complex numbers, define z  w to mean 
Re (z) < Re (w) and Im (z) < Im (w). It 1s reflexive and transitive, but 
not symmetric. 


Problem Set 1.3 


1. Determine whether each of the relations defined below on the set 
S is reflexive, symmetric or/and transitive Pick out the equivalence 
relations, 

(a) xRy @exacyri:S=R 

(bd) xRyexx=2y:S=Q 

(c) xR yp ox-—yis divisible by2: Sm Z 

() xRy < x is the brother of y: Sis the set of all human beings 

(ec) xRy ~ xCy: S is the set of all subsets of R 

(f) x Ry < x is married to y : S is the set of all human beings 

(kx) xRyeox=ly|: S=R : ‘ 

(bh) xRy wox=m-—-y:S=Q 

(i) xRy @ sinx —siny: S=R 

(ij) 7Rwe {[zi[m[wl: Se C 

(k) xRy <x and y are students of BITS: S is the set of all 
students of India, 
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1.4 FUNCTIONS 


The reader must have already been exposed, in his earlier training, to 
a proper definition of functions and operations with functions. However, 
as the concept of a function is very fundamental to mathematics and its 
applications. we shal! now give the basic ideas about functions relevant 
to our subject. 

1.4.1 Definition Let A and B be two nonempty sets. A function (map) 
f from A to B is a rule which, to each element of A, associates a 
unique element of B. Symbolically, we write 

f:A>B. 

For each x € A, the unique element of B associated with x is denoted 
by f(x) and is called the image of x by (under) f or the f-image of x or the 
value of fat x. We also say that x is mapped into f(x) by f. x itself is 
said to be a pre-image of f(x) under f. A is called the domain of f written 
as D(f). It is the set on which / is defined. B is called the target set of f. 
It is the set to which the images belong. 

For clarity, we often draw a diagram as in Figure 1.2. 


f(x) 


Target set 


FIGURE 1.2 


We shall set up a number of conventions on usage, by means of a 
simple example of a function : Consider the function f: R — R defined by 
the rule, which, to each x € R, associates the value x”. So f(x) = x? for 
allx & R. By abuse of language, we sometimes say that the function is x?, 
and we even use the symbol /(x) for the function. Very often, we use the 
more precise language that the function is given by (x) = x°, x € R. 
Alternatively, we denote this function as the set {(x, x9) | x © Rj of or- 
dered pairs. This set is also called the graph of the function; because, if 
we plot the points (x, x°) in a plane, we will get the geometrical curve 
representing the function. 

We shall now illustrate the foregoing ideas by listing seven ways of 
expressing this x*-function. The first four methods are technically perfect, 
and methods (y) to (vii) are sanctified by custom and usage. 

(i) f: R-» R defined by x +> x’, 

(ii) ff: x => xi forallx € R. 
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(iii) ff: Ra — R defined by f(x) = x’. 

(iv) f= {(x, x®) | x € R}. 

(v) The function x* defined on R. 

(vi) The graph of the function is {(x, x°) | x € R}. 
(vii) The graph of the function is as in Figure 1.3. 


Y 


FiGur_E 1.3 


Note that the symbol ‘t->’ used tn (i) and ‘ii) is different from the 
symbol ‘->’ for a function. The symbol ‘->’ is used when we want to 
specify the domain and target set of f, whereas ‘t—>’ is used when we want 
to indicate the image of a single element of the domain. Thus, x +> x? 
means that the image of x is x*. On the other hand, when we write 
f:A-— B, we are not specifying the image of a single element. 


Though we shall allow oursélves the liberty of using any of these 
methods to specify a function, in the sequel, more often than not, we shall 
adhere to methods (i), (ii), and (if). In case there is doubt while using the 
other methods, the reader should go back to the first three methods for 
clarification. 


It may be noted that, if it is possible to list, without ambiguity, all the 
values of f(x) as x varies in the domain, we do so, and we alsv say that 
this list is the function. 


Now we emphasise the word ‘unique’ occurring in the definition of a 
function. For each x € A, f(x) should be unique. In other words, f 
cannot have two or more values at a given x. For example, if A = {1, 2, 
3, 4, 5} and B = (—1, 2, —3, 4, —5, 6, 0}, then the association 1 > — 1; 


12 | SETS AND FUNCTIONS 


2 >2and0; 3 r> —3; 4 +> 0,5 +> —5 is not a function, since the 
image of 2is not unique. 


Example 1.29 A = {\, 2, 3, 4, 5, 6} and B = {—1, 2, —3, 4, —5, 6, 0}. 
Define f: A —> B by saying f(1) = —1, f(2) = 2, f(3) = —3, fl4) = 4, 
JS) = —5, and (6) = 6. This function is nothing but {(1, -- 1), (2, 2), 
(3, —3), (4, 4), (5, —5), (6, 6)}. 

Example 1.30 Given A and B as in Example 1.29, define f: A > Bas 
follows : f(1) = —1, f(2) = 0, f(3) = —3, f(4) = 0, /(5) => —5, f(6) = 0. 
This function is nothing but {(1, —1), (2, 0), (3, —3), (4, 0), (5, —5), 
(6, 0)}. 

Example 1,31 Define f: R > Rby f(x) = | x | . This is called the absolute 
value function. 


Example 1.32 Define f: R’ > Rby f(x,, X,) = X, + X3. To each point 
(x;, X,) in R’*, this function associates the real number x, + x,. In other 
words, to every pair (x, y) of real numbers, this function associates their 
sum x + y. Therefore, this function is called addition in R. 


Example 1.33 In the same manner as in Example 1.32, multiplication in 
R can be written as f : R? — R defined by f(x,, X,) = X4%-¢. 


Example 1.34 Fix areal number A. Then f: x &> Ax for allx € Ris a 
function, called (scalar) multiplication by A. 


Example 1.35 Let « bea fixed real number. Then f: x +> x + « for all 
x € Risa function, called translation by «. 


Example 1.36 f: xt— 0 forall x € R isa function, called the zero func- 
tion or the zero polynomial on R. It is denoted by 0. Note that f(x) = 0 
for all x € Rand its graph is just the x-axis. 


Example 1.37 Let A and B be two nonempty sets and b, € B be a fixed 
element. Then the function f: A —> B defined by f(x) = 5, for all x € A 
is called a constant function. Note that Example 1.36 is a special case of 
this function. 


Example 1.38 The function f: A — A defined by f(x) = x for allx € A 
is called the identity function on A and is usually denoted by Ia. 
Example 1.39 Let n be a nonnegative integer and ay, a, ..., a, be fixed 
elements in R. Then the function 
Pix Fray t+ xt... a,x", xER, 

s called a real polynomial function on R or simply a real polynomial on 
R. Note that itis a map from R to R. By abuse of language, a, -+ a,x 
+ ... + Gyx" itself is called a polynomial. To denote the fact that 
Gg, 2, ..., A, are real, it is also called a polynomial with real coefficients, 

If a, 3 0, then n is said to be the degree of the polynomial a, + a,x 
++ ... + a,x". The set of all real polynomials is denoted by 7, and the 
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set of all real polynomials of degree not greater than n is denoted by ,. 
Note that the zero polynomial, 0, belongs to both ? and 7,. The degree 
of the zero polynomial is, by convention, assigned to be —co. Similarly, 
p:C-—> C given by p(z) = ay + a,2 +... + Gaz", where dp, a, ..., dy ate 
complex numbers, is called a complex polynomial on C. 
Example 1.40 Define f: ? -> R by flip) = p(0) for all p € F. For ins- 
tance, if the polynomial is p : x +> 2x* + 1, then f(p) = 1. Note that 
this is not a comstant function. (Why 7) 
Example 1.41 Let N be the set of natural numbers. Then any function 
f:N-—>R can be written asthe set of ordered pairs {(1, f(1)), (2, f(2)), 
(3, f(3)), ..-}. Such a function is called a sequence of real numbers. The 
sequence is also written as ; 
FU), f(2), £3), 
For instance, 2, 4, 6, 8, ... is asequence. It is just the function x+—> 2x 
on N. 
In the discussion of any function /, there are four fundamental ques- 
tions : : 
(i) What is the domain of f? 

(ii) What is the range of f ? 

(iii) Is the function ‘onto’ or not ? 

(iv) Is the function ‘one-one’ or not ? 


We have already introduced the domain of f. We shall now introduce 
the concepts related to other questions. 


1.4.2 Definition Let f: A — B be a function and y € B. The pre-image 
of y is the set {x € A | f(x) = y}. 
1.4.3 Remark An accepted notation for the pre-image of y under f is 
f(y). However, we shall not use this notation in this sense. 
Example 1.42 Define f: R —» R by the rule f(x) = x*. The pre-image 
of 4 is {2, —2}, and the pre-image of 0 is {0}. The pre-image of —1 is 
the empty set >. 
1.4.4 Definition Let f: A — B bea function. The set { f(x): x € A} is 
called the range of f and is denoted by R(f). 
It is in fact the set of all f-images. 
1.4.5 Definition A map f : A.B is said to be onto (surjective) if 
R(f) = B. 
Clearly, the following statement is true. 


1.4.6 Fact Amap/: A -> B is onto if either one of the following proper- 
ties holds : 


(a) For every ye B, there exists at least one xG A such that 
f (x) = y. (1) 


h 
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(b) For every y € B, the pre-image of y is a nonempty subset 
of A. (2) 

The proof of this fact is left to the reader. 

We now consider Examples 1.29 to 1.41 with reference to the foregoing 
definitions. The function f: x — x* from R to R is not onto, because the 
negative real numbers have empty pre-images. 

In Example 1.29 R(f) = B\. {0}. So / is-not onto as also the function 
in Example 1.30, because ; 

R(f) = {-1, —3, —5, 0}. 

In Example 1.31 R(f) = {x | x > 0}. So fis not onto. But in Example 
1.32 the range is R, since every number in R can be expressed aS x,-+2%, 
for suitable real numbers x, and x, in at least one way. Hence, the map 
is onto. 

The function of Example 1.31 is onto because the range is R. The 
reason is similar to the one giver for Example 1.32. 

In Example 1.34, if A + 0, the range is R, because every number in R 
can be expressed as Ax for a suitable x in R. The map is onto in this case. 
If A = 0, the range is {0} and the map is not onto. 

In Example 1.35 the map is onto, since the range is R. (The reader 
should reason this out.)~ But the map of Example 1.36 is not onto, as the 
range is {0}. This is an extreme case of a function not being onto. 

The map in Example 1.37 is, in general, not onto as the range is {09}. 
It becomes an onto map if Bisa singleton. In Example 1.38, since the 
range is A, the map is onto. 

In Example 1.29, unless p is specified, the range cannot be calculated. 
For example, the polynomial p : x +> x + 1 is an onto function, whereas 
the polynomial g: x t—> x* + lis not. (Why ?) 

In Example 1.40 the range is R (why 7), so the map is onto, whereas in 
Example 1.41 the map is not onto, because the range is {/(1), /(2), ...}. 
It is a proper subset of R. The proof of this is beyond the scope of our 
treatment. 


1.4.7 Definition A map f : 4-— B is said to be one-one (injective) if 
distinct elements of A are mapped into distinct elements of B. 

The function x +> x*, x € Ris not one-one, because we can find several 
pairs of distinct elements x,, x, that have the same image, e.g. both 2 and 
—2 map into 4. 

Clearly, the following statement is true. The proof is left to the reader. 
1.48 Fact Amap/: A -> B is one-one iff any one of three properties 

holds : 
fa) x yw fix) # f(y). (3) 
(b) f(x) = fly) > x = y. (4) 
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(c) The pre-image of each element in the range of f is a single- 
+ ton. (5) 
Note that whenever we want to prove that a certain function is one-one, 

we have to prove (3) or (4) or (5). 


1.4.9 Remark The name ‘one-one’ comes as follows : Already in the 
definition of a function, given x, f(x) is unique. The requirement 
of Definition 1.4.7 further asS¥ets that, given f(x), x is unique. 
Thus, the correspondence x +» f(x) is unique both ways. Such 
a correspondence is called a one-one correspondence. Hence the 
name one-one function. 

Let us now check which of the examples from 1.29 to 1.41 are one- 
one, 
In Example 1.29 the function is one-one. In Example 1.30 it is not, 

because the pre-image of 0 is {2, 4, 6}. 

In Example 1.31 fis not one-one, because for any x © R, x and —x 
both map into the same image. 


In Example 1.32 fis not one-one, because a number can be expressed 
as the sum of two real numbers in more than one way. For instance, 
7=3+4=5+42. Sof(3, 4) = 7 =f (5,2). Fora similar reason, the 
multiplication function of Example 1.33 is not one-one. 

In Example 1.34, if A 0, (scalar) multiplication by A is one-one, because 
Ax, = AXg > X, = 24, which proves (4) in Fact 1.4.8. If A = 0, the map 
is Clearly not one-one. 

In Example 1.35 translation by ‘a’ is a one-one map, because 
X, +a = X%, + ax, = X. 

The maps of Examples 1.36 and 1.37 are clearly not one-one, because 
all members of A are mapped into one member of B. In fact, this is the 
extreme case of not being one-one. On the other hand, the map of 
Example 1.38 is one-one. 

In Example 1.39 whether or not the function is one-one depends upon 
the polynomial, because the polynomial p: x |—> x + 1 is one-one, where- 
as the polynomial g : x +> x* + 1 is not one-one. (Why ?) 


The map of Example 1.40 is not one-one, because (x+1) and (x?+1) 
have the same image. 


In Example 1.41 also the one-oneness depends upon the sequence, 
e.g. the sequence 1, 1/2, 1/3, 1/4, ... is ome-one, whereas the. sequence 
1, 1, 1, ... is not one-one. ; 
1.4.10 Definition Two sets 4 and B are said to be in one-one correspond- 

ence if there exists a map f: A —> B that is one-one and onto. 
1.4.11 Definition Ifa set A is in one-one correspondence with the set 
fl. 2. .....a}. for some positive integer ”. A is said to be a finite set. 
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Sets that are not finite are called infinite sets. 


For example, the set of all real roots of the equation x* — 2x4 — x +2 


== O and the set of vertices of the triangle ABC are in one-one corres- 
pondence. Both are finite sets, since they are in one-one correspondence 
with the set {1, 2, 3}. 


N, Q, R, Z, and C are all infinite sets. (Why 7) 


Problem Set 1.4 


Determine which of the following subsets of R x R are functions : 

(a) {(1, 1), (1, 2), (1, 3), (1. 4), (1, 5D} 

(b) (01,1), (2,1), 3,0, (4 0) (5, D} 

(c) {(1, 2%), (x, 1), (0.2), (e, 13 

(d) {(7, €), (x, 1), (1, €), (e, 1}. 
For the given sets A and B, define, if possible, a function f: 4 > B 
such that (i) f is onto but not one-one, (ii) f is neither one-one nor 
onto, (iii) f is one-one but not onto, (iv) f is one-one and onto : 

(a) A = {a, b,c, d}, B = {0, 1, 2, 3} 

(b) A = {l, 2, 3}, B = {0, }, 2, 3} 

(c) A = {0, 1, 2,3}, B = {l, 2, 3} 

(d) A= R, B=R. 
Determine the largest subset A of R for the function f: A+R 
defined as follows : 

(a) f(x) = Ve’ — 1) (b) fix) = V(4-x*) 

(c) f(x) = x/(l +) (d) f(x) = x*—2x+7 

(ce) f(x) = x/(¥* +1) (f) f(x) = SG? — x*). 
Determine the largest subset A of C for the function f: 4—>C 
defined as follows : 

(a) f(z} =([z| (b) f(z) = z/|z| 

(c) f(z) = Re (z) (d) f(z) = exp(i Im(z)) 

(e) f(z) = exp(Re (2) (f) f(z) = =z. 
Determine the range of each of the functions in Problems 4 and 5. 
Determine which of the functions in Problem 4 are one-one and 
which onto. 
True or false ? 

(a) There is a one-one correspondence between A x Band B x A. 

(b) There is a one-one correspondence between C and R x R. 


(c) If A and B are finite sets, then every one-one map f: A -> B is 
also onto. 
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(d) If A and B are finite sets, then every onto map f: 4-—> B is 
also one-one. 

(ce) A nonempty subset of a finite set is also finite. 

(f) Every nonempty subset of an infinite set is infinite. 


8. Determine which of the following graphs represent functions : 


y v 
@ 
& 

0 x 9 x 

(a) (b) 
Y Y 

i 
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0 > , x 

(¢) (d) 
y y 
Pr Xx 5 ———_—_—____- —- x 


(e) (f) 
1.5 BINARY OPERATIONS 


We shall now introduce a very important class of functions which in- 
cludes the familiar operations of arithmetic, namely, addition and multi- 
plication. If we look back carefully at the operation of addition of 
numbers, we find it is essentially a process of combining two numbers and 
obtaining another number in an unambiguous way. The same is true of 
multiplication. A generalisation of this idea is the following definition. 


1.5.1 Definition Given a nonempty set 4, any function from A x A to A 
is called a binary operation on A. 
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In other words, to each ordered pair (x, y) of elements x and y of A, 
the binary operation * on A associates a unique element z of A. We 
write z = xX # y, 

The functions defined in Examples 1.32 and 1.33 are binary operations 
on R. But the (scalar) multiplication by a fixed A in Example 1.34 is not 
a binary operation on R, because it is not a function on R x R. It does 
not associate a number with every pair of numbers in R. 

Note that though addition is a binary operation on R or Nor Q or 
the set E of even integers, it is not a binary operation on the set of odd 
integers, because the sum of two odd integers is not an odd integer. We 
formalise this situation by the following definition. 


1.5.2 Definition Let BC A. Let * be a binary operation on A. If for 
each pair of elements (x, y) in B, x *y belongs to B, we say that 
B is closed under ‘s’, \f there exist x, y in B such that x+y & B, we 
say that B is not closed under ‘+’. 

Note that the situation ‘B is (not) closed under ‘*’’ is sometimes 
referred to as ‘‘*’ is (not) a closed operation in B’. 

To illustrate Definition 1.5.2, let us consider a couple of examples. 
Example 1.43 The set of odd integers is not closed under the usual addi- 
tion of numbers, but it is closed under multiplication. 

Example 1.44 The set N is not closed under division, but it is closed 
under addition. 

The reader should note that unless Bis closed under ‘#’, it cannot be 
a binary operation on B. We now give some examples of binary opera- 
tions. 

Example 1.45 f : (x, y) t->x — y is a binary operation on RX. Itis also 
a binary operation on Q, Z, and C, but it is not a binary operation on N. 
Example 1.46 f : (x, y) +> x/y is a binary operation on R\ {0}. We 
cannot have the whole set R here, because x/y is not defined when y = 0. 
It is also a binary operation on C \, {0}, 2 \, {0}, but not on Z \, {0} 
or N. (Why ?) 
Example 1.47 f : (x,y) t+ x + y — xyisa binary operation on C, R, 
Q, and Z, but noton NV. (Why ?) 
Example 1.48 f : (x,y) t> x” is a binary operation on N, but not on Z 
orQorR. (Why?) 
Example 1.49 f :(x, y) #>|x—y | isa binary operation on Q, Z, R, 
and C, 
1.5.3 Definition A binary operation * on a set A is said to be 

(a) commutative ifa+b = bea forall a,b € A; 
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(b) associative if a (bac) = (a*b)«c foralla,b, e€ A, 

Whenever ‘s’ is associative, we can write a *b *c in place of a* (b#c) 
or (a * b) #¢. 

The usual addition and multiplication of numbers are both commuta- 
tive and associative. The operations defined in Examples 1.45, 1 46, and 
1.48 are neither commutative nor associative. But in Example 1.47 the 
operation is both commutative and associative. In Example 1.49 the opera- 
tion is commutative, but not associative. The reader should check these 
statements carefully. 

We shall not discuss nonassociative binary operations in this book, 
but we shall deal with some important noncommutative binary opera- 
tions. 


Problem Set 7.5 


1. Define addition ‘+’ and multiplication ‘x’ on the set S = {a, B, +} 
with the help of Tables 1.1 and 1.2. 


TABLE, 1.1 TABLE 1.2 
ick ec eee x a 6 ¥ 
a a 6B y¥ r a a @ 
B |B y «@ Bia 8 
y | y «a 8 Y | @ ¥ 


Prove that the binary operations ‘+’ and ‘x’ as defined by these 
tables are commutative and associative. 


2. Define the binary operation ‘*’ on R, the set of real numbers, as 
follows : 
xey> xy txt+yp. 
Is ‘#? commutative ? Is ‘*’ associative ? 
3. Give an example of a binary operation, which is 
(a) associative but not commutative 
(b) commutative but not associative 
(c) neither commutative nor associative. ‘ 
4. Define addition ‘+’ and multiplication ‘x’ in R x Ras follows: 
(%1, ¥a) HH (1s Va) = (%1 + Ya, Xe + Vs) 
(X31, Xg) X (Var Ya) = (%1 Yur Xa Yo)- 
Prove that these are commutative and associative binary operations, 
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given that (x, X,) = (y;, yp) Means x, = y, and xX, = js. 
5. Define the binary operations ‘+’ and ‘x’ on R x Ras follows : 
(X1, %g) + Was Ve) = (%y + Vy Xe + Yo) 
(X35 Xs) X (Ya, Ya) = (HV. — X2¥a, Ha + %2)1)- 
Prove that both these operations are commutative as well as associa- 
tive. (Equality is defined as in Problem 4.) 
6. Let Z, be the set of nonzero real numbers. Define addition ‘+’ and 
multiplication ‘x’ on Z x Z as follows: 
(Xy. Xs) + (Vay Ya) = (Xie + XaV1, X9ys) 
(X1, Xg) X (Vis Va) = (% V1. XgV2). 
Prove that these are commutative and associative binary operations, 
given that (x, x3) = (71, Ys) Means Xyy_ = Xg);. 


1.6 ALGEBRAIC STRUCTURES 
FIELDS 


The standard properties of real numbers with respect to addition and 
multiplication are so fundamental in mathematics that whenever any set 
X with two binary operations ‘+’ and ‘-’ (called addition and multipli- 
cation) satisfies these properties, we give a special name to such a system. 
It as called a field. To understand these properties, which are listed in 
the following formal definition, the reader is advised to think of X as the 
set R of real numbers and the operations ‘+’ and ‘-’ as the usual addi- 
tion and multiplication in 2. 


4.6.1 Definition Let X be a nonempty set on which there are two binary 
operations ‘+’ and ‘-’ , called addition and multiplication, respec- 


tively. Then the set X together with these operations is said to be 
a field, if the following axioms are satisfied : 


Fl Addition is associative. 


F2 There exists an element 0 € X with the property thatO +a =a 
+0 = aforallac X. 


F3 For each a € X, there exists an x € X¥ such thata+x=0 
=x + a, 


F4 Addition is commutative. 

FS Multiplication is associative. 

F6 There exists an element 1 € X such that 1-a = a = a-1 for all 
ae X. 

F7 For each a (<0) in X, there exists an clement y © ¥ such 
that a-y = | a y-a, 
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F8 Multiplication is commutative. 
F9 Miultiplication is distributive over addition, that is, for all 
a,b,c EX, 
a-(6+c)=a-b+a-c 
and (a+ b)-cma-c+b-c. 

In the case of XY == R the element x mentioned in F3 is just the fami- 
liar —a, the negative of a, and the element y mentioned in F7 is just 
the familar 1/a, the reciprocal of a. 

Axioms F1 to F9, which are valid in R, are fundamental. Starting from 
them, all the formulae of elementary algebra can be derived. 

The classical examples of fields are, besides R, 

(i) the set Q of rational numbers under the usual addition and multi- 
plication and 

(ii) the set C of complex numbers under the usual addition and multi- 
plication. 

In this book we shall be interested in only these three fields, namely, 
R, Q, and C. 

Z is not a field under addition and multiplication, because F7 is not 
satisfied. So also Nis not a field. (Why ?) 


GROUPS 


Now we take up another structure in algebra, which is simpler than a 
field. Suppose we restrict our attention to only one binary operation on 
a nonempty set XY and denote it by ‘+’. If this satisfies axioms Fl, F2, 
and F3, we say that the system is a group. If, in addition, F4 is satis- 
fied, we call it a commutative group. We shall now give the formal defi- 
nition. 

1.6.2 Definition Let G be a nonempty set on which a binary operation ‘s’ 
is defined. Then G is said to be a group, under the operation ‘+’, if 
the following axioms are satisfied : 

Gl ‘s#’ is associative. : 

G2 There exists an element e € G such thate*a = a =ave for 
alla € G. eis called an identity for ‘+’. 

G3 For each a € G, there exists an element x € G such that 
Qex=€ =x * a, x is said to be an inverse of a for the cpera- 
tion ‘s’. 

If, in addition, 

G4 The operation ‘s’ is commutative, 

then the group is said to be commutative or abelian. 
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Let us consider four examples : ; 
(i) R, Q, and Z are groups under the usual addition operation. 
(ii) N, under addition, is not a group, because G2 and G3 are not 
satisfied. 

(iii) Q\ {0} and R\ {0} are both groups under the operation of usual 
multiplication. The number 1 plays the role of ‘e’ in the definition. 

(iv) The set Z\ {0}, under multiplication, is not a group, because G3 
is not satisfied. 

In all these four examples of groups the operation is commutative. .So 
they are all commutative groups. However, noncommutative groups are 
of great importance in mathematics and its applications. Watch for some 
examples of noncommutative groups as we go along. 

Before we proceed, we shall establish the uniqueness of the ‘identity’ 
referred to in G2 and the ‘inverse’ referred to in G3. 

1.6.3 Theorem (a) Ina group G there is only one identity, ie, the identity 
is unique. 
(bo) For a given element a in a group G there is only one inverse, i.e. 
the inverse of an element a € G is unique. 
Proof: (a) Let e and e’ be two elements in G, both having the 
property stated in G2, namely, 
e#a=az=are forallacG (1) 
and 
esa=az=are’ forallac G. (2) 
Then taking e’ for a in Equation (1), we get 
: exe’ = ese = e’, 
and taking e for a in Equation (2), we get 
e’se—erse’ =e, 
Hence, e = e’, i.e. the identity is unique. 
(b) Given a € G, let x and y be two elements in G, both having the 
property stated in G3, namely, 


aex=xea=e (3) 
and 
aey=yea=e. (4) 
Therefore, y= yre (by G2) 
= ys#(a*x) (by (3)). 
But the operation ‘*’ is associative in G. Hence, we get 
y = (ye alex 
= €e Xx (by (4)) 
om x (by G2). 
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This proves that the inverse of each element is unique. §j 

Thus, hereafter, we shall speak of the identity in a groupG and also of 
ihe inverse of an element a € G. 

Whenever the operation is denoted by ‘+’, the identity is denoted by 
‘0’, and the inverse of ‘a’ is denoted by ‘—a’. It is customary to write 
a—bfora + (—)d). ; 


RINGS 


Another important structure is that of a ring. Let us once again 
consider the nine field axioms. The first four axioms—F1, F2, F3, and 
F4—are pertinent to addition, whereas the next four axioms—F5, F6, F7, 
and F8—are pertinent to multiplication. The ninth axiom, F9, pertains to 
both addition and multiplication, 


If there is one binary operation on a set X and the four axioms F1 to 
F4 are satisfied, then the system is a commutative group. Ifa set X has 
two binary operations and all the nine axioms are satisfied, we say the 
system is a field. In between these two situations, we have a ring 
structure. 

Suppose a set X has two binary operations. Let, for the first operation, 
the system ‘be a commutative group. The minimum that we require of the 


second operation, in order to get a meaningful system with two operations, 
is the associativity F5 and the distributivity F9. 


So whenever: there are two operations, say ‘+-’ and ‘-’, on a set X, and 
Fl to F4, and F5 and F9 are satisfied, we call such a system a ring. 


We shall not give a formal treatment of rings in this book. It suffices 
to note that 
(i) A set X with two operations ‘+-’ and ‘-’ such that (a) it is a 
commutative group for ‘+-’ and (b) F5 and F9 are satisfied is called a 
ring. 
(ii) A ring in which F6 holds is called a ring with identity (unity). 
(iii) A ring in which F8 holds is called a commutative ring. 


For example, C, R,.Q, and Z are rings under the usual operations of 
addition and multiplication. All these are commutative rings and have 
unity. The set E of even integers is a commutative ring under the opera- 
tions of addition and multiplication. But it has no unity. ‘ 


Watch for further examples of rings as we go along. 


Problem Set 1.6 
1. In each of the Problems 1, 5, and 6 (Problem Set 1.5) prove that 
$ 
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the set under consideration, along with the operations of addition 
and multiplication defined therein, is a field. 


2. Let G be an abelian group with addition ‘+-’ as the binary operation. 
Prove the following identities in G : 
(a) —(-a—b) =a+bdb (b) a—O =a 
(c) —(a—b) = b—a ’ (d) (c— 6) — (a — 5b) = c— a. 
3. Let A bearing with ‘+’ and ‘-’ as binary operations. Prove that, 
for a, b, c,d € A. 
(a) (—a)-(—b) = a-b 
(b) (a+b): (c+d) = a-e+b-d+a-d+b-ec. 
4. Prove that a ring contains at most one unity. 
Prove that a - 0 = 0 for all a in aring A. 
Give three reasons why N is not a field under the usual addition and 
multiplication. 


Aw 
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The standard operations on functions, which yield new functions from 
the given ones, are (i) composition, (ii) addition, (iii) scalar multiplication, 
and (iv) multiplication. 


Before we begin a study of these operations, we have to make precise 
what we mean when we say ‘two functions are equal or are the same’. 


1.7.1 Definition Two functions f: A> Band g: A->B are said to be 
equal, written f = g, if f(x) = g(x) for all x € A. 
For example, the function x +> x’ defined on [—1, 1] and the function 


x +> x* defined on [0,1] are not equal, because their domains are 
different. 


1.7.2 Definition Let f: A— Band g: BC betwo functions, Define 
the function 4 : A + C by 
h(x) = g(f(x)) forallxE A. 
Then h is called the composition of g and f and is denoted by go f, 
which is read as ‘g composite f’. Thus, we have (g o f) (x) 
= g( f(x)) for all x € A. Symbolically, the composition can be 
represented as 
fg gof 
A~>B—>Cax2A—C, 
Example 1.50 Let f: R-> Rbe defined by x > x + landg:R—>R 
be defined by x t-> x*. Then go/f is defined, and (go f) (x) = g(f(x)) 
az g (x-+-1) = (x + 1). Hence, gof:x > (x +s 1)' is a map from Rto R. 
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Example 1.51 Let f: R — Rbe defined by x +> x+1landg: RtoR 
be defined by x +> 4/x. Here Rt is the set of all positive real numbers. 
In this case go f is not defined, but fo g is defined, since 


g f fog 
R+->R>R= Rt-——> Rk. 
and (fog) (x) = f(g (x)) 
= fiVvx) = Vx 1. 


Thus, fog: x ™> Vx + 1 isa map from Rt to R. 


Example 1.52. In some cases both fog and gof may be defined. In 
Example 1.50 fog is also defined and (fog) (x) f(g (x)) = J(x*) 
== x? + 1. . 

Thus, in this case fog : R-—R is defined by x +> x? + 1, but 
gof:R-— Ris defined by x +> (x + 1)*. 

These examples show that when fog is defined, go f may or may not 


be defined. Even when both fog and go /f are defined, they need not be 
equal. In other words, composition of functions is not commutative. 


\ 

Notations The set of all functions f from A to B is denoted by $(A, B). 
if Bb - R, the set of real numbers, then the function f: 4 -—> R is said to 
be a real-valued function. The set of all real-valued functions on A is 
denoted by (AR). The notation {Fr(A) is also used to denote this set 
of real-valued functions. If R is understood from the context, the symbol 
(A) can be used. If A is an interval, $(A) is written also as F[a, bj 
or F(a, 5). ; 
1.7.3 Definition Let f: A— R and g: A—>R be two real-valued func- 

tions. Then the sum f+ g is defined as a real-valued function as 

follows: f + g:A-> R such that x +> (x) + g(x). In other words, 

(f + g) (x) =f (x) + g (x) for all x € A. 

f +g, as defined, is called the pointwise sum of f and g. According 

to this definition, f + g is also a member of $(A). 


Example 1.53 Let f: R->R be defined by f(x) = x* and g:R—>R 


y= sin x 


Ficure 1.4 
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be defined by g(x) = x + 1. Then f+ gisthefunctionx x+x+1 
for allx € R. 


Example 1.54 Let us add the sine function and the cosine function, These 
functions are given by the graphs in Figures 1.4 and 1.5. Therefore, the 


FIGURE 1.5 


function sine ++ cosine is given by the rule (using Definition 1.7.3) 
(sine + cosine)(x) = sin X + cosx. 
The graph of the function sine + cosine is as in Figure 1.6. 


y = sinx +cos x 
ra 


o 


/ 


y = cos x 


y= sinx 
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1.7.4 Definition Let A be a real number and f: A — R be a real-valued 
function. Then Af, called the scalar multiple of f by A, is defined 
as a real-valued function 

Af: A—> R such that x +> Af(x). 

In other words, (Af) (x) = Af(x) for all x € A. Af is called the pointwise 
A-multiple of f. According to this definition, Af is also a member of (A). 
Example 1.55 Let f: R->R be given by x +> x, Then Af is the func- 
tion from R to R such that x +> Ax’. 


Example 1.56 The graph of the function 1/2 sine, i.e. A-multiple of sine, 
with A = 1/2 is given in Figure 1.7. 
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A special case of scalar multiplication when A = —1 gives (—1) f as 
the function 


(—-DS) (x) = (—1) (f@)) = +f) forallxE R. 
(—1)f is also denoted by —/f. 
1.7.5 Definition Let f: A — R and g:A—>R be two real-valued func- 


tions. Then fg, called the pointwise product of f and g, is defined 
as a real-valued function 
fe: A— Rsuch that x +> f(x) g(x) . 
In other words, (fg)(x) = f(x) g(x) for all x € A. 
Example 157 Letf: R-»>R be defined by x f > x* and g: R-> Rbe 
defined by x t>x+ 1. Then the function fg: R-> R is defined by 
x E> x2 (x + 1). 


Example 1.58 The graph of the product of sine and cosine is given 
in Figure 1.8. 


SK 


ao 


y = cosx Bt ere 
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1.7.6 Remark We have constructed functions f +g, Af, and fg. The 
construction of f +g from f and g is nothing but an operation 
which, to each pair of functions f and g of F(A), associates a func- 
tion f + gin §(A). Thus, this operation is a binary operation on 
F(A). It is called addition. The second operation, that of forming 
Af from A and f, called scalar multiplication, is not a binary opera- 
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- tion on (A). The reason is that we do not take two functions in 
F(A) to produce a function in F(A). However, the multiplication 
of functions f and g is a binary operation on $(A). 

We shall refer to Definitions 1.7.3, 1.7.4, and 1.7.5 as pointwise addition, 
pointwise scalar multiplication, and pointwise multiplication of functions, 
respectively. Throughout the book, without further explanation or mea- 
tion, addition, multiplication by ascalar, or multiplication of functions is 
to be understood pointwise as already explained. 

The following properties of addition in (A) are easy to check. They 
should not be taken for granted. The reader should carefully check 
them. 

(i) Addition in $(A) is associative. 

(ii) G2 is satisfied for additibn in (F(A), because the zero function, 
0, acts as ‘e’ of G2. 

(iti) G3 is satisfied for addition in {F(A), because — f acts as the in- 
verse of f for addition. 

(iv) Addition in $(A) is commutative. 

Thus, (A), for pointwise addition, is a commutative group. 

Analogously, we have, for multiplication, the following properties. 
The reader should carefully check them. 

(i) Multiplicasion in $(A) is associative. 

(ii) G2 is satisfied for multiplication in {F(A), because the constant 
function C : A -> R such that x t+ > | acts as the identity in (4). For 
we have 

(Cf) (x) = C(x) f(x) = 1 f(x) = f(x) for all x € A. 
Hence, by Definition 1.7.1, Cf = f for all fin $(A). 

(iii) Multiplication in (A) is commutative. 

(iv) Multiplication is distributive over addition in F(A). 

But ¥ (A) for pointwise’ multiplication is not a group, because G3 is 
not Satisfied as we shall now show. 

Suppose f: A — R is a function such that /(x,) = 0 for some Xo € A. 
In order to get a function g : A -» R such that fg = C, we must have 

(fg) (x) = C(x) forallx € A 
Or f(x) g(x) = C(x) = 1 forallx € A. 

‘But at x = Xy this means Og(x,) = 1. No real number g(x,) can 

satisfy this requirement. Therefore, no g exists with the property fg = C. 


This meags there are functions f in F(A) which have no inverse for multi- 
plication. 
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If we look at all the properties of addition and multiplication which 
we have listed, we find that {$(.4) is @ commutative ring with unity for 
these two operations. 


The question whether $(A) is a group for scalar multiplication does 
not arise, because scalar multiplication is not a binary operation. But 
scalar multiplication does satisfy certain properties, which we now list. 


, Given f/f, g © F(A), and A, » € R, we have 
(i) Mf+ 8) = 4+ Ag, 
(u) At pf = ¥ + of, 
(ili) A(ef)= Awf = pQf), 
(iv) A(fg) = AS) g = fag), 
(v) If =f. 
The reader should check these carefully. Just for guidance we check (ii), 
namely, 
Q+ ws = Aft of. 
Since this 1s an equality between functions, we have to prove 
(A + pf) (x) = AS+ uf) (x) for all x € A. 
The left-hand side = ((A + p)f) (x) 


= (A + p) (f(x)) (by Definition 1.7.4) 

= Af(x) + pf (x) (by F9 since Risa 
field) 

= (Af) (x) + (uf) (x) (by Definition 1.7.4) 

= (Af + uf) (x) (by Definition 1.7.3). 


1.7.7 Remark By now it must be clear to the reader that addition. multi- 
plication, and scalar multiplication of functions are not the same 
as addition, etc., of ordinary numbers, though they may appear 
to be so. He should be careful to understand, at any stage of the 
working, whether the symbol that is being used is just a number or 
a function. 


All the results in this article are also true for $c{A), 1.¢. the set of all 
complex valued functions on A. The only precaution we have to take 
is that A, instead of being just a real number, can be any complex number. 

We shall end this article by introducing an important concept, called 
inverse function, 

1.7.8 Definition Let f: A — B be a one-one and onto function. Then 
the inverse of f, written as f “*, is the function 
f[i:BoA 
defined by 
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f-4(y) = that unique x € A for which f(x) = y. 

Note that Definition 1.7.8 is valid, because by Remark 1.4.9 it 
follows that, since f is one-one and onto, there is a one-one correspondence 
between A and B. 

Example 1.59 Let f: R—> R be defined by x +> x + 1. Thenf?: RR 
is given by f(y) = y "for ally € R. 

If the function f: A — Bis not one-one or not onto, the inverse does 
not exist as a function from B. 

If the function f: A —> B is one-one but not onto, the inverse does not 
exist as a function from B. But the situation can be retrieved by modifying 
the function f. Write ff : A > R(f) by defining f(x) - f(x) for all x € A. 
Essentially, f; is the same as f. The only difference between f and /f, is 
that the target set B of / has been restricted to R(f) C B without any 
damage. 

Obviously, f, is one-one and onto; so f, has an inverse. This inverse 
is defined on R(f). Therefore, some authors say (legitimately!) that 
though the inverse of f does not exist as a function from 8, it exists as a 
function from R(f), a subset of B. 

We shall now give two important properties. If f: A — B is one-one 
and onto, then 

(i) fofi = Ip and 

(ii) frto f = Ia. 

The proof of (1) is left to the reader. We shall prove (11) : 

f: A— Bisa one-one and an onto map. Therefore, f-! : B > A exists. 
The composition f-!0/ is a map from A to A such that 

(f-tof) (x) = f-(fS(x)) (by Definition 1.7.2) 
= fly) (by writing y == f (x)) 
= X {by Definition 1.7.8) 
for allx € A. Hence, fof = Ih. 
As mentioned in Remark 1.4.3, the symbol /~! is also used in certain 


contexts in mathematics for denoting the pre-image under f. But we shall 
not use f"! in that context. We shall use /-' only when it is the inverse 


of f. 
Problem Set 1.7 


1. Prove that the composition of functions is associative, i.e. for any 
three functions h: A > B,g: B-> C, and f: C > D, we have 
(fog)oh m» fo(goh). 
2. Let Stix) = sinx,-7w<x <x 
and g(x) w» BHO KX < OD, 


10. 


Al. 
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Describe gof. Is fog defined? Justify your answer. Change the 
domain of g so that fog can be defined. Then describe fog. 
Repeat Problem 2 for f(x) = 1 + x?, -1 <x < 1, and g(x) = vx, 
x > 0. 
Prove that the set of all real-(complex) valued continuous functions 
defined on [0, 1] is a group under pointwise addition of functions. 
Prove that the set of all real-valued differentiable functions on (a, 5) 
is a group under pointwise addition. 
If f and gare defined as in Problem 2, describe f + ¢, f ~ g, and 
fefor —n<x<zr. 
If f and g are defined as in Problem 3, describe f + g, f — g and 
Sg forO <x <1. 
In R* define equality, addition, and scalar multiplication as follows : 
Equality (Xy, X2) = (1, Ye) if X1 = Vy, Xy = Yq; 
Addition (X, %3) + (Yi, Ye) = (%, + Vas Xe + Ys); 
Scalar multiplication o(x,, X2) = (ex;, ax,), where a is any real 
number. 
A function f: R? —> R? is said to be linear if it satisfies the following 
properties : 

(1) SCX, Xe) (Yas Va) = S(% ys 2) + SO Ys) 

(it) f(a(x,, *5)) == af(X1, Xq), 
for all real a. 

Prove that each function f: R* — R® defined below is linear. 

(a) f(y, %) = (%, %) 

(b) f(xy, %,) = (%1, —%;) 

(c) f(%1, %y) = (%y + %y, x, — X,). 
Prove that for the linear function f: R’® -» R* defined in Problem 8, 
we have : 

S(O, 0) = (0, 0). 

Consider ¥(G, H), the set of all functions from a group G to a non- 
abelian group H with a binary operation ‘-'. For f, g € $(G, H), 
define fg as (fg) (x) = Ax)- g(x). Isfg = gf? . 
True or fasle 7 


(a) The function f: C -» R defined by f(a + ib) = a is an onto 
function. 


(b) The function f: C -» R defined by f(a + ib) = b is a one- 
one function. 
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(c) The function f: C+ Rx R defined by f(a + ib) = (a, 5) 
is a one-one onto function. 

(d) It is possible to define multiplication of functions, which is 
noncommutative. 

We conclude this article by drawing the reader’s attention to the two 
ideas in this chapter that will form the central theme of this book. They 
are ‘addition’ and ‘scalar multiplication’ of functions. The study of these 
two concepts in depth and in more general situations is the study of linear 


algebra. 


Chapter 2 


Vectors 


In this chapter we shall study vectors in a plane and in space. These 
concepts originally arose in mechanics. A vector in mechanics stands for 
a line segment directed from a point P (called the initial point) to a point 


—s 
Q (called the terminal point). It 1s denoted by the symbol PQ, where the 
arrow indicates that it is a vector. The addition of vectors is done by the 


> 
familiar law of parallelogram of forces. The negative of PQ is denoted 


by OP. From this the rule of subtraction follows. The study of vectors 
starting from this approach is called the geometric approach. 

The alternative approach, called the algebraic approach, is more rele- 
vant to the subject matter of this book. Whereas the geometric approach 
leans heavily on the fundamental geometric concepts of ‘length’ and ‘angle’, 
the algebraic approach uses only the properties of R, the set of real 
numbers. 

Today we find that the use of vectors transcends its original geometri- 
cal background of physical space and finds its application in various fields, 
including social sciences. For this reason, our study of vectors will be 
mainly algebraic. The geometric aspect will, however, be presented side 
by side, in order to supplement the understanding. In fact, keeping track 
of the geometrical perspective is very useful in that it provides a deeper 
insight into the study of linear algebra. At the end of this chapter some 
elementary applications of vectors to geometry are also presented, 

We are familiar with the cartesian coordinate system in a plane. Before 
studying vectors we shall introduce the cartesian coordinate system in 
space. 


2.1 SPACE COORDINATES 


We identify a poiat in a plane with the help of two axes, called the 
x-axis and the y-axis. To locate a point in space, we need three mutually 
perpendicular lines X'OX, Y’OY, and Z'OZ through a point O (Figure 2.1). 
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This point O is‘called the origin and the lines are called x-axis, y-axis, and 
z-axis, respectively. These three mutually perpendicular lines, called the 
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coordinate axes, determine three mutually perpendicular coordinate planes 
XOY, YOZ, and ZOX, called the xy-plane. the yz-plane, and the xz-plane, 
respectively. These three planes divide space into eight parts, called 
octants. Note that 

x-axis is the intersection of the xy-plane and the zx-plane; 

y-axis is the intersection of the xy-plane and the yz-plane; and 

z-axis is the intersection of the yz-plane and the zx-plane. 

We choose the positive directions OX, OY, and OZ of these axes in 
such a way that, if a right-handed screw placed at O 1s rotated from OX 
to OY through 90°, it moves in the direction of OZ. The axes so chosen 
are said to form a right-handed system. Figure 2.2 shows a right-handed 
system and Figure 2.3 shows a left-handed system. 

Let P be a point in space (s¢e Figure 2.1). Then the distance of P from 
the xy-plane is called the z-coordinate of point P. Let Q be the foot of 
the perpendicular from P on the xy-plane. Then the distance of Q from 
the y-axis is called the x-coordinate of point P and that from the x-axis 
the y-coordinate of point P. Obviously, the x-coordinate of point P is its 
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distance from the yz-plane and the y-coordimate is its distance from the 


x-plane. 
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If ., v, and » are respectively the v-coordinate, 
-coordinate of point P, we use the ordered triple (x, y, z) to denote P. It 
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is customary to say that the cocrdinates of P relative to the origin O are 
(x, y, 2). Thus, corresponding to each point in space, there exists a unique 
ordered triple of real numbers which gives the distance of P (x, y, z) from 
the three coordinate planes. Similarly, corresponding to each ordered 
triple of real numbers, there exists a unique point in space, which is situated 
ut a distance of x units from the yz-plane, y units from the zx-plane, and Z 
units from the xy-plane. Obviously, the coordinates of the origin are 
(0, 0, 0). 

Distance between the points P,(x, Y,, 21) and P(X, Ye, 24) 


To find the distance between the points P, and P,, draw P,Q perpendi- 
cular from P, to the plane P,RQ parallel to the xy-plane and passing 
through P,, as shown in Figure 2.4, Further, draw QR and P,R parallel 
to the x-axis and y-axis, respectively. Then 


PP. = J/ (P,Q) + (P,Q)? 
Vv ((RQ)* + (PR)? + (P.Q)* 

= af (X.— X41)? + (Me — 1)? + (2 2)" . (1) 
Example 2.1] The distance between the points P(1, —1, 3) and Q(2, 1, —7) 
is (—10) + (2) + 1? = v 105. 


Problem Set 2.1 


1. Locate the points : 
(a) (1,1) (b) (1, 1,2) (c) (—1, 3, —2) 
(d) (—1, —2, —3). 

2. Describe the loci : 


(a) y = constant (b) Z = constant 

(c) x = 1, y = 2z (d) y = —5, 22 = 4x 
(ec) yzt* = l,x = 2 (f) x <0 

(gy) x 2y (h) y > 22, x = 3. 


3. Find the length of the segment AB, with end points : 
(a) A(O, 0,0), B(I, I, 1) 
(b) A(1, 2, —1), B(O, —1, 1) 
(c) A(3, 2, —1), B(3, 1, 2) 
(d)} A(—1, 3, —2), BU, 2, 0). 
4. Look at the rectangular parallelepiped in Figure 2.5. If its length 
AB = 3,5 units, breadth BC = 2 units, and height BD = 1.5 units, 


and the coordinates of A are (1, 2, 3), find the coordinates of all its 
vertices and the length of its diagonals. 
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2.2 VECTORS—ADDITION AND SCALAR 
MULTIPLICATION 


We start with the geometrical concept of a vector. A vector is a direct- 

ed line segment PQ with an initial point P and a terminal pointQ?. In 
: —> —> 

Figure 2.6 PQ and RS are two vectors. The length or magnitude of vector 


gq ® 


a . 


FIGURE 2.6 


Ss 
PQ is the distance between P and Q and is denoted by | PQ |. A vector 
of unit length is called a unit vector. 

Two vectors OP and OP’ are said to be parallel if the line segments 
OP and O'P’ are parallel. Two parallel vectors may have the same or 
opposite directions. In geometry two parallel vectors are considered to 
be equivalent if they have the same length and the same direction. In 

am =p au 
Figure 2.7 OP, O'P’, and RS are patallel vectors, and OP and RS are 
equivalent vectors. However, in mechanics the need may arise to consider 
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— ap 

them as different. For example, OP and RS may represent two forces 
acting at two different points O and R. In our study of vectors we shall 
ignore this distinction between initial points. We shall assume that there 


is always a coordinate system with an origin O. Given any vector AB, 
unless otherwise stated, we shal] always think of a parallel vector OP 
with an initial point O and a terminal point P such that OP and AB have 
the same directions and | OP | = AB | , as in Figure 2.8. 


Y 


FIGURE 2.8 
e — —? e s 
Note that, given AB, we arrive at only one OP in this way. Thus, all 


our vectors shall start from a fixed point, namely, the origin, in the chosen 
coordinate system. Such vectors are also called free vectors. 


P " P Cay.a9) 


(a) (b) 
Ficure 2.9 
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Consider the vector OP in a plane, where P is the point with coordi- 
nates (@,, @,) relative to the chosen coordinate system referred to O as 
origin (Figure 2.9). 

—> ——> —>P 

The sum of two vectors OP and OQ is given by OR, the diagonal of 
the parallelogram whose adjacent sides are OP and OQ (Figure 2.10). If 
P and @ have coordinates (c,, @,) and (5;, b,), respectively, then elementary 
geometry tells us that the coordinates of R are (a, + 5,, a, + 6). (Why ?) 
Suppressing the directed line segments and writing only the coordinates 
of the vertices, we have Figure 2.10 (b} . 
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—> 
Geometrically, AOP, with A > 0, 1s defined as the vector whose length 


—> 

is A-times the length of OP, i.e. A] OP |, and whose direction is the same 
—> —> — 

as that of OP. If A < 0, then AOP denotes a vector of length —A| OP | in 


_s 
a direction opposite to that of OP. As before we get the pairs of diagrams 
as shown in Figures 2.11 (a) and (b), and 2.12 (a) and (b). (In these dia- 
grams |A| > 1.) 


An analogous situation arises in space, where the point P has the 
coordinates (a,, @,, &s). 


A>O, OP’= A0P 
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A<0, OP=A0P 
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If we carefully analyse the transition from (a) to (b) in Figures 2.10, 
2.11, and 2.12, we observe that the coordinates a, and a,in the plane (and 
the coordinates a@,, @,, and @, in space) of the point P perhaps contain every- 


thing that we want of the vector OP. It is this observation that leads to 
the following algebraic definition of a vector and to the succeeding defini- 
tions in this chapter. 


2.2.1 Definition (a) A plane vector is an ordered pair (a,, a,) of real 
numbers. 
(b) A Space yector 1s an ordered triple (a@,, a,, 23) of real numbers, 
We shall not make any distinction between the plane vector (@,, a,) and 


the directed jine segment oP, where O is the origin and P is the point 
whose cartesian coordinates are (a,,4,). In fact, we shall very often 
write 
——>> 

u = (4;,4,) = OP. 
In this case the vector (@,, @,) is also called the position vector of P. The 
vector (0, 0) is called the zero vector ina plane. Similarly, in the case of 
space vectors, we write & = (@,, G3, @3) = OP. The vector (0, 0, 0) is 
called the zero vector in space. 


The length or magnitude of the vector # <= (a@:,4,) = OP is the length 
of the segment OP. It is «/(ai + aj). In the case of the space vector 


w= (Gy Gy @) = OP, wehave |w| = (ai + a3 + a3). 

Example 2.2 The length of the vector (3, 4) is +/(9 + 16) = 5, 
Example 2.3 The length of the vector (1, 3,— 1) is (1 + 9+ 1) = V1), 
Example 2.4 The vector (4/2/10, —74/2/10) is a unit vector, since its 
length is 1. 


Example 2.5 The vector (1/+/3, t/+/3, ~—1/4/3) is a unit vector, since 
its lengthis |}. - 
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2.2.2 Definition (a) The set of all plane vectors (i.e. the set of all ordered 
pairs of real numbers) is denoted by V3. 
(b) The set of all space vectors (i.e. the set of all ordered triples of 
real numbers) is denoted by V,. 
Note that V, is the cartesian product R x R. For this reason V, may 
also be denoted by R*. Similarly, VV, = RX RXR = R*, 


2.2.3 Definition (Equality) (a) Two plane vectors (a, a,) and (d,, 5) 
are said to be equal if a, = Db, and a, = by, i.e. (a,,a,) = (b,, b,) 

if a; = b,, i == l, 2. 
(b) Two space vectors (a, a2, a3) and (5,, b,,b3) are said to be 
equal if a, = by, dy = by, and dy = dy, i.e. (Gy, Gy, 3) = (01, bg, Bg) 

if a, = b,, i = 1, 2, 3. 
The direction of a nonzero vector in V, is the radian measure 0, 
0 <6<(27, of the angle from the positive direction of the x-axis to 


the vector OP measured counter-clockwise. If w = (a;, a.) = OP, then 
the direction 6 of w js given by 


: a 
sin 0 = ae ee 2 cos 0 = = 
Va; + a? Va + a,? 


In V, the direction of a vector is given by its direction cosines, which 
we shall study in § 2.4. Note that the direction of the zero vector is 
undetermined. 


Example 2.6 The direction 9 of the vector (1/4/2, 1/-+/2) is given by 
sin 6 <= 1/2 = cos® SoO = n/4, 

Example 2.7 The direction of the vector (3, 4) is given by sin @ = 4/5, 
cos 9 = 3/5. 


Now we shall define the addition of two vectors in a plane as well as 
in space. These definitions correspond to the geometrical definition of 
addition. 

2.2.4 Definition (Addition) (a) Addition of vectors in V, is defined as 
(a,, dy) + (5;, b,) eae (a, + b,, a, + be) 
for all vectors (@,, a@,), (5,, 5,) in V2. 
(b) Addition of vectors in V; is defined as 
(a,, as, ds) + (5, by, bs) — (a, + b,, Gs + b,, a, + 5s) ‘ 

for all vectors (4,, Gg, 25), (5;, 5g, 53) in V3. 
Example 2.8 The sum of the vectors (3, —1) and (—1, 4) is the vector 
(3, —1) + (—1, 4) = (2, 3). 


Example 2.9 The sum of the vectors (—1, 0,7) and (3, 2,1) is the 
vector (~—1, 0, 7) + (3, 2, 1) = (2, 2, 8). 
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Obviously, these operations of addition ‘+-’ are binary operations in V, 
and V,, respectively. We shall now prove that V, and V, are comntutative 
groups for these operations. 


2.2.5 Theorem V,(V;), the set of all plane (space) vectors, under the ope- 
ration of addition, as in Definition 2.2.4, is a commutative group. 


Proof: The proof for V, is left to the reader. To prove that V, is 
a commutative group, we check the following : 
G1 Vector addition is associative 
Let w = (a;, a,), ¥ = (b,, 5,), and w = (¢,, c.) be three vectors in 
V,. Then 
(a + v) + w = ((a, + 5,) +c, (ag + 5g) + Cy) 
and ut(v tw) = (a, + (B+ ,), ag + (by +.) . 
But we know that for real numbers a,, b;, and c, (cf § 1.6) 
(2, + i) + ¢, = d, + (hb, + 4), i= 1, 2 . 
Therefore, (#@ -+ v) + w = w+ (v-+ w) for alluyy,w Ee V,. 
G2 Existence of identity 
For any ¥ == (a), a.) in V,, we have 
(0, 0) + (a, a) aa (a, ay) = (a, dg) a (0, 0) . 
So the zero vector (0, 0) plays the role of identity. The zero vector 
usually denoted by 90. 
G3 Existence of inverse 
Given a vector « = (a1, a,), the vector x <= (—a,, —a,) Satisfies 
x+u=0=—-a+e. 
This vector x is called the additive inverse of u or the negative of « and 
is denoted by —z. 
G4 Vector addition is commutative 
Let w = (@,, a,) and v = (b,, b,) be two vectors in V,. Then 
a-+v = (a, + d,, a, + Dy) 
and v+a= (5, + a,b, +4,). 
But we know that for real numbers a,, a,, b,, b, (cf § 1.6) 
i b, = b, +a, i Vee 2 
Therefore, wu + vy = » + uforallu,» € V,. 
This completes the proof that V,, under the operation ‘+’, is a 
commutative group. §j 
It may be noted that the additive identity of the group V, is the vecton 
(0, 0, 0). We shall use the same symbol 0 for this vector aleo. In V, if 
wm (4;, Gy, ag), then —w = —(G;, Mg, Gg) o* (—Ayp~- Gg, —Gy). 
2.2.6 Definition (Scalar multiplication) Multiplication of vectors in V, by 
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a real number is defined as 
A(@y, Gs) = (Ad, Ad) 
for every (a, a.) & V, and every real number A. Similarly, in Vz, 
d (Qi, Gg, Ay) = (A ay, As, AQs) 
for every (a,, a3, 23) € Vy and every real number A. 


Example 2.10 If the vector ws = (3, —1), then the vector 2u == (6, —2) 
and 4u = (J, —1/3). 


Note that scalar multiplication is not a binary operation. (Why 7) 
However, it does satisfy certain natural properties which we shall Jist and 
prove. 

2.2.7 Properties of Scalar Multiplication 
For all vectors u,v in V, (or in V3) and real nwnbers a, B, we have 
(a) afu +) == au + ay, 
(b) (x -+ 6 mw = au + Bu. 


(c) a(S2) = (afju = Blan). 
(d) iw = a. 
(ce) Ou = 0. 


Proof: We shall prove (a) as an illustration of the method of proving 
these properties. Further, we shall prove this in V,; only. The rest are 
left to the reader. 

Let uw = (a,, a, a3) and» = (6,, b,, b,) be two vectors in V3, and a 
be a real number. Then 
B+ Pr = (a, + by, a. + be, a3 + 5s) 
and a(u + ¥) == (a(az + 5,), a(a, + 5), a(a, + 5,)) 
= (aa, + ab,, ad, + ah,, 2a, + aby) (1) 
by properties of real numbers (cf § 1.6). Further, we have 
anu -f- ay a(d,, as, a) ad a(d,, b,, b,) 
= (aay, ad;, aa3) + (ab, aby, abs) 
== (ad, + ab,, ad, + ab, Xa, + abs) 
=a(e+yr) (by (1)). §j 
The last two properties, namely, (d) and (¢), may look trivial te the 


I 


reader. In fact, they just say ‘ 
1(@;, Gg, Gg) == (1a,, 1a, 15) (Definition 2.2.6) 
= (a,, Bey as) 
and 


O(a, Gq, 4) = (Oar, Ody, 00,) (Definition 2.2.6) 
w= (0, 0, 0) . 
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Let the reader reserve his opinion until he comes to the discussion of 
an abstract vector space in Chapter 3. Then he will see the significance 
of properties (d) and (e) and also the delicate difference between them. 


2.2.8 Definition The difference of two vectors w and », written asu — Pp, is 
defined by a — v a+ (—p). 

Example 2.11 Let w = (3, 4),v = (—1, 3). Thens —v = uw + (—») 
= (3, 4) + (1, —3) = (4, 1). | _ 

We shall now find the vector # — vy geometrically. Let a = OP 
= (a,, ad) and ¥ = 00 == (b,, 5,). The negative of », ie. —yv, is 
(—bi, —5,). Geometrically, it is the vector QO which is the same as 
OO’ (see Figure 2.13), where Q’ is the point whose cartesian coordinates 


Rlay—by,a 


Q"-by»-b,) 
FiGure 2.13 
are (—5,, —b,). The vector # — vy is the diagonal of the parallelogram 


formed by w and pv. It is the vector OR = OP == (0, — by, a, — 5,). 
Analogously, we can find wy — v in V3. 


For every nonzero vector uw, the vector l : i wis a unit vector in the 


direction ofw. Ifa = (a,, a,) ~ 0, the unit vector in the direction of w# is 


—— ee een ‘is 
Va +a?’ Va’ + a,? 
Ifa (@,, 4g, @3) 3 0, the unit vector in the direction uw is 


(- Qi ay ): 
rE Eee we 9 Tr wee ee oe ot 

Va) + a7 + a? Va; + a7 + a7 * Va, + a,* + at 

Example 2.12 If = (3,4), the unit vector in the direction of w it 

(3/5, 4/5). 


Example 2.13 If « = (1, 1, 1), the unit vector in the direction of w is 
(1/4/3, 1/4/3, 1/4/3). 
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In a plane the unit vector in the direction of an angle 6 is (cos 9, sin 6), 
as shown in Figure 2.14. It is also called the unit vector at an angle ® with 


y 
P (cos 6, $1n 8) 


FiGURE 2.14 


the positive direction of the x-axis. The unit vectors in the positive 
directions of the x-axis and the y-axis are (1, 0) and (0, 1), respectively. 
They are denoted by i and j, respectively, 1.e i = (1, 0) and jf — (0, 1), 
as in Figure 2 15. 


(0,1) 


FIGURE 2.15 


In space the unit vectors along the positive directions of the x-axis, 
the y-axis, and the z-axis are respectively (1, 0, 0), (0, 1, 0), and (0, 0, 1). 
They are denoted by i, j, and k, respectively, ic. i = (1, 6, 0), 
j = (0,1, 0), and A = (0,0, 1). Though we use the same letters # and 
j here as in the case of plane vectors, there cannot be any confusion, 
because the context will always show whether we are talking of plane 
vectors or space vectors. The importance of unit vectors is brought out 
by the following theorem. 
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2.2.9 Theorem (a) Every plane vector is of the form @,é + a,j and every 
vector of this form is a plane vector. 


(b) Every space vector is of the form a,i -+- Gq j -+ ask and every vector 
of this form is a space vector. 
Proof: We shall prove (b). The proof of (a) is analogous. Let 
(@,, @g, 23) be a vector in V;. Then 
(a,, aq; Gs) _— (4, 0, 0) = 5 (0, ae, 0) + (0, 0, a3) 
am a,(1, 0, 0) i &,(0, l, 0) + a,(0, 0, 1) 
== Gi -+- a,j a a,k : 
Thus, every vector in V, is of the form a,i + a,j + a,k. On the other 
hand, a vector of the form a, + a,j + a,k is the sum of vectors a,i, 
a,j, and a,k of V;. Since vector addition is an associative binary opera- 
tion, 2,2 + a,j + ak is a vector in V3, i.e. a space vector. § 
Geometrically, Theorem 2.2.9 means that every vector can be represent- 
ed as a sum of scalar multiples of unit vectors along the coordinate axes, 
as shown in Figure 2.16. 
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The numbers a,, a, are called the components of the plane vector 
w= (a; a.) = a, + a,j. a, is called the i-component (or x-component) 
and a, is called the j-component (or y-component). We also say that 
a, and a, are the coordinates of # with respect to i and j. 

Similarly, @,, a,, and a, are called the components of the space vector 
w= (0, dy, G3) = Gi + a,J + ak. a, is the i-component, a, is the 
j-component, and a, the A-component. We glso say that a, a,, and a, are 
coordinates of # with respect to i, j, and &. « 


Problem Set 2.2 


1. Find the magnitude and direction of the following plane vectors : 
(ec) i+j (f) 2a—-¥ (s) ~i+4) (hb) —4 —2/. 


10. 
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Find the magnitude of the following space vectors : 


(a) (2, _ l, 3) (b) (3, 0, 4) 

(c) #3 +4—k (d) ~i— 2 + 4k. 
Simplify 

(a) 3(2, — 3) (b) 4(1, — 1, 3) 


(c) 2(1, — 1) — 7(5, 1) (d) 3(2, — 1,4) + & — 1, 5, 0) 

(ec) 7(3i + 2j — k) — 402i — j + &). 

Express the following vectors in terms of the unit vectors é, j, and & : 

(a) (2, 3) (b) (—1, 4) (c) (—3, —5) 

(d) (5, 3, —2) (e) (2,0, 1) (f) (—1, 2, 0). 

Express the following space vectors as sums of scalar multiples of 
w= (1,1, 1), » = (1, 2, 3), and w = (2, 3, 5): 

(a) (1, 3, 5) (b) (7, — 1, 3) (c) (2, —2, 1) 

(4d) i+j—k (e) — 22+ j —5k (f) 38 — 77 — 2k. 
(Hint : Assume each vector to be equal to (« uw + 3 vy -—+ 7 w), where 
a, B, and y are real numbers.) 

Find a unit vector win the direction of each of the vectors in 
Problems 1 and 2. 
Find the unit plane vector in the direction : 

(a) 6 = —3n/4 (b) 6 = 7/6 (c) 6 = 7x/4. 
Given a point A, determine a point B such that the vector AB 1S 

equal to the vector pv in the following : 

(a) »v = (1, —2, 3), A (0, 1, —1) 

(b) »v = (3, 1, —2), A(—], 2, 3) 

(c) » = (3, —7, 1), ACI, 5, 0) 

(d) v = (1, —1, 1), 4 (2, 3, 5) 

(ec) » = (1, —2), A(l, —2) 

(f) v = (-—1, 5), A(7, —3). - 

Given the midpoint of AB, determine the points 4 and B such that 
the vector AB is equal to the vector v in the following : 

(a) vy = (1, 3), midpoint of AB is (1, 2) 

(b) » = (—1, 2), midpoint of /4B is (0, 0) 

(c) vw = (3, —1, 2), midpoint of AB is (3, —1, 2) 
(d) » = (—2, 0, 1), midpoint of 4B is (2, 3, —2). 
Prove that V, together with the operation of vector addition is a 

commutative group. 
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—> —> 
11. Let ws = OA and vw = OB be two vectors. Then prove that 
—s 
u—y = BA. 
12, Prove the properties of scalar multiplication (b) and (c) stated 
in § 2.2.7. 
13. Prove that ce = Oiffe = Oora = 0. 
14. Let w bea nonzero vector in V,. Then prove that the set 
S = {aw | a € Ris a group under vector addition. 


15. Let wand yp be two nonzero vectors in V3. Then prove that the set 
S = fou + By | a, B € R} is a group under vector addition. 


16. True or false ? 
(a) 4(2,0, 4) = (1, 0, 4). 
(b) (@+b,b+c¢,c+a)+(¢c,a,6) = (a+ b+ c)(1,1, 1). 
(c) 26+ 37 = 37 + 20. 
(d) i+ j+ kis a unit vector. 
(ec) 0 — (a,b) = (—a, Dd). 
— —> —>- 
(f) OP— OO = PQ. 
(g) If wand vy are vectors, then uv has not been defined so far. 
(bh) ad = 0. 
(i) On = 0. 
(j) The zeros on both sides of (e) in § 2.2.7 are different. 


(k) Let ABC be a triangle. Then AB + BC + CA = 0. 
2.3 DOT PRODUCT OF VECTORS 


We start this article with the definition of the angle between two 
vectors. 
— ——> 
2.3.1 Definition Letw = OP and v = OQ be two nonzero vectors. 
Then the angle between w andy, u + Ay, is defined as the angle 
—> ——> 
of positive measure 9 between OP and OQ interior to the triangle 
POQ (Figure 2.17). If a = Ay, then the angle 9 is defined as 8 = 0, 
ifA> 0, and6 = xz, ifA < 0. 
It follows from Definition 2.3.1 that0 <9 <=. We shall now prove 
the following theorem, which gives the angle between two vectors, 
———> 
2.3.2 Theorem Let w = (a1, ay, 4;) = OP and v = (b,, by, b) = OO 
be two nonzero vectors in Vs, Let 6 be the angle between w and y. 
Then 
—s o> 
| OP | | OQ|cos 6 = a,b, + a,b, + a,b, . (1) 
Proof : If 0 < 6 < x, consider the triangle POQ (see Figure 2.17). 
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FiGure 2.17 


—> —> —> 
We have OP = OP — OQ. From geometry, we have 
——» ——} —_—> —_ ——} 
|OP|?+|OQ|? —2|OP| | OQ|cos6 = | QP|® 
—_— — —> ——> oy 
or 2|OP| |OQ|cos® = | OP|* + |0Q|? — | OP]? 
is | (a, Qa, a) |? 7 (d,, be, b,) ie 
— | (a, — 5,, @,— b, ag — 55) |? 
= (a? + a,” + a,°) + (0,° + 5? + 5%) 
—(a, — 5, — (a, — 5,)° — (a, — 5§) 
—= 24,6, + 2a,b, 4- 2a,b,. 
a,b, + a,b, + ayb3. 


lt 


— — 
Therefore, | OP | | OQ | cos 4 


——> 
Now let 6 = 0 or 0 = =. In these cases we have OP = B09, 
where 6 >> 0, if = 0, and 8 < O,if 8 = nr, ie.8 =|] cos6. Thus, 


(a,, ay, as) ae B(d,, bs, bs), 1.€. a= Bb,, i= I; Zz; 3. 


_——> —> —> 
Hence | OP | | OQ|cos® = |f| | OQ |* cos8 
| B | (cos @) (b,° + 5° + 64°) 
B(d,? + ,” + b,") 
= a,b, + Gybz + agby, 
because a, = 6b,,i = 1, 2, 3. 
A similar result can be obtained for plane vectors. We have only to 


I 


——> 

suppress the third coordinates a, and 3. In this case, if w = (a,, a) = OP 
——> 

and vy = (6,, b,) = OQ, we have 


——>> ——> : 
| OP | | OQ\|cos® = a,b, + a,b,, (2) 
where 0 is the angle between the vectors a and ». 
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Example 2.14 Letw = (3, 2) and» = (2, 5). Then the angle 0 between 
the vectors w and y is given by 
| (3,2) | | (2, 5)] cos® = 6+ 10. 

16 _ 16 | 
V13 V29 Vv 377 
Example 2.15 Let w = (1, —1, 3) and v = (3,1,1). Then the angle 
0 between the vectors uw and » is given by | (1, —1,3)| | (3, 1,1) | 
cos 0 = 3 —1+ 3. Socos® = 5/11. 

Now we shall define the dot product of two vectors. Actually, there 
are two different ways of multiplying two vectors. In one the product is 
a real number, whereas in the other the product is a vector. In this article 
we shall consider the first kind of product. The second kind will be dealt 
with in Chapter 6. 


So cos § = 


—> —> 

2.3.3 Definition Let u = OP and v = OQ be two nonzero vectors and 
6 be the angle between them. Then the dot product (also called scalar 
product or inner product), written as u - y, is the real number defined 
by 

—> —> 
u-v =|OP| |OQ|cos6 = |a| |v|cosé. (3) 

If either w or v is the zero vector, then w - v = 0. 


This definition is based on the geometric concept of the angle between 
two vectors. However, Theorem 2.3.2 gives an algebraic expression for 
the dot product of # and y in terms of their components. ST EnES: Definition 
2.3.3 may be equivalently written as follows. 


2.3.4 Definition Let u = (a,, a,) and v = (5,, b,) be two vectors of V,. 
Then the dot product uw - yw is defined by 


u-v = ab, + aby. (4) 
If w = (4, ag, a3) and v = (b,, bg, b,) are vectors of V;, then u- y 
is defined by° 


u-v = a,b, + ub, + ayb, . (5) 


Note that the formation of the dot product is mot a binary operation. 
(Why 7?) However, it satisfies the following properties. 


2.3.5 Properties of the Dot Product 
Let u, v, w be vectors in V, (or in V,) and a, B be real numbers. Then 


(a) w-u =|u|?; henceu-u>0. (6) 
(b) w-u = Oiffx = 0. (7) 
(Cc) wv =p-n. (8) 
(4d) w-(vtw) = Bev +uw, (9) 


(ec) (am)-» = a(e- py) m= wy - (ay). (10) 
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Proof : We shall prove these properties for vectors in V,. Analogously, 
by suppressing the third coordinate, we can prove these properties for 
vectors in V,. Let u = (@,, Gg, ds), V == (0, 55, bs), Ww = (Cy, Cg, Cy), and & 
be a real number. 

(a) w-u=a+ai+a, = [a|?*. 
(b) If # = (0, 0, 0), then w-u = 0. Conversely, if w-a = a," 
+ a? + a, = 0, then a, = a, = a, = 0, because a,’, a,*, 
and a,’ are all nonnegative. Hence, w = (0, 0,0) = 0. 
(c) w-v = a,b, + a,b, + a,b, = ba, + ba, + ba, = ve ° 
(d) w-(v-+w) = a,(b, + cy) + @,(bg + C2) + G3(b3 + Cs) 
== (@,D, + Ggby + Qybg) + (AC, + OgC, + Gy¢) 
=v +u-w. 
(xa,)b, + (aa,)b, + (att3)d, 
a(a,b,) + a(a,b,) + «(a5b;) 
= a(a,5, + a,b, + a,b5) —_= on ( a . vy). 
Similarly, uw - (av) = a(u-v). § 
Another important property satisfied by the dot product is the follow- 
ing. 
2.3.6 Schwarz Inequality 
For any two vectors u and v of V, (or V)., we have 
lu-v] <jal lel, 


(e) (eu): » 


i.e. 
@-v? < (w- u(y). (11) 
Proof : If either w or vy is the zero vector, there is nothing to prove. 
So we assume that w and yw are nonzero vectors. Let 0 be the angle 
between w and v. Then, by Definition 2.3.3, we have 
cos 6 = 
[wily] 
But |cos91< 1, Therefore, 
ju-rv([< | w | lvl, 
ic. (w- vr c[ul ?jv[?*=—=@w-a-v). J 
Example 2.16 The dot product of the vectors (2, 1) and (—1, 6) is 
(2,1) - (—1, 6) = —2+ 6 = 4. 
Example 2.17 The dot product of the vectors (1, —1, 3) and (0, 1, —3) 
is 0 + (--1) + (-—9) —10. 
Example 2.18 For any real numbers a,, a,, a3, b,, bs, and b,, we have 
(@,b, + ab, + ayb,)* < (@,” + a? + a,”) (6,7 + bo + 5,*). 
(Hint : Apply Schwarz inequality to the vectors w ="(a,,4,,a,) and 
v om (5,, by, d;).) 
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Applying the definition of dot product to the vectors i, j, and &, we 
have 
i-fi=jejr2k-k=1 (by 2.3.5 (i)) 
and i-jejeke=k-i=0. 
We know that 0-s% = 0 == a-0 for any vector #. The converse ts 


not true, i.e, w+ » = 0 need not imply that either of the vectors w or v isa 
zero vector. For,i + j = O but i and jf are both nonzero vectors. 


. In general, if w and y are nonzero vectors and if #- » = 0, then in view 
of Definition 2.3.3, cos 9 = 0, where 6 is the angle between wand v. In 
other words, # and v are perpendicular to each other. Thus,w-v = 0 
implies that either u = 0 or» = Oor w and v are perpendicular to each 
other. 


2.3.7 Definition Two vectors w and vy of V, (or V;) are said to be orthogo- 
nalifu-v = 0. 


Note that 0 is orthogonal to every vector w and i, j, k are pairwise 
orthogonal. 

Example 2.19 Letu = (1, 2,3) andv = (2, — 7,4). Thenw -» = 2 — 
14+ 12 = 0. Sow and» are orthogonal. 

Example 2.20 Letu = (1, 2,3) andy = (2, — 5,4). Thenu-» = 2 
— 10+ 1240. Sow and vy are not orthogonal. 

Every vector wu = (qa,, a,) in a plane can be expressed as the sum of 
two orthogonal vectors af and a,j. a,i and a,j are called the resolved 
parts of w respectively along and perpendicular to the x-axis. In general, let 
a and y be two vectors. If we express w as a sum of two vectors w, and w, 
such that », is parallel to vy, and w, is orthogonal to », then w, and w, are 
called the resolved parts of uw respectively along and perpendicular to ». 
In such a case, we have 


u= WwW, + We, 


where w, = Av for some real number \ and w, - v = 0. 


Hence, 
wey = (Ww, + Ww.) v = wW-v + we: 
= (Av) - rp = Avy). 
Thus, 
“ey. 
A = sp tev #0. 
Therefore, 


w, = ——" v and w, = 8— WwW, = U— —~y (Figure 2.18). 
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Uv, 
0 V.V 


FIGURE 2.18 


We have thus proved the following theorem. 


2.3.8 Theorem Let vy be a given nonzerosvector. Then any nonzero vector 
uw can be expressed as the sum of a vector parallel to vy and a vector 
orthogonal to y. 


; uryv_. 
In the foregoing discussion the vector w; = di called the vector 
projection of u along vy. 


The scalar projection of won v is | u|cos 9, where 6 is the angle 


between w and v. Obviously, the scalar projection of wonvis 4” and 


|v | 


the vector projection of w along v is 


ee gi, ee v 
y-vy [vt [rv 


== (scalar projection of # on y) times the unit vector 
in the direction of v. 

Thus, the magnitude of the vector projection of w along vy jis the absolute 
value of the scalar projection of zon w and the direction is the same as 
that of v, if 6 < 7/2, and Opposite to that of v, if 8 > 2/2. If 8 = 2/2, 
the vector projection of w along v is 0. 
Example 2.21 Let wu = (j,2,3) = i+ 27+ 3k and vw = (—2, 3, 0) 
= —2i-+ 37 + 0k. Then 


scalar projection of w# on vy Is Tet =e re = aE 
ee . a 4 
vector projection of w along vy is © = (—2, 3, 0) 
8 i?) 
= ig ae Oe 
Also 
w= (1,23) 8+ B+ 3k = (— Hit j +08) 


vee + 4454 8) 
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This is the dice ia of : — and perpendicular toy. The reader 


can check that (— — ee ~ J + 0k) is along v and. (= i+ 


j + 3k ) is perpendicular to v. 


Problem Set 2.3 


Work out Problems 1 through 4 for each pair of vectors # and y given 


as follows, 


SS eee 


(a) w = (1,1), » = (—1,3) 

(b) # = (—2, 5), » = (1, —6) 

(c) w= i+, v= 2-7 

(d) w= —3i+ 5), 9 = 64+ 4 

(ec) w = (1, 3, 5), » = (—3, I, 1) 

(f) w = (2, —1, 4), » = (1, 2, —1) 

(g) w= -—i+jtk r= 3H-—-AB+k 

(h) w= GW—-J+tkh v= i+jftsk. 
Find # - ». 
Find the cosine of the radian measure of the angle between w and v. 
Find the scalar projection of w on ». 
Find the vector projection of vy along u. 
Find the rea] number a such that the vectors uw and y given as follow 
are orthogonal. 

(a) w = (2,a,1), » = (4, —2, —2) 

(b) wa = (1, —2, 1), v = (2,1, @) 

(c) w = (0,3, —2), » = (a, 4, 6) 

(d) w = («, —3, 1), » = (a, a, 2), 

For any vector #, prove that 

w= (u- ii + (w+ fj + (we: Wk. 

Let w and pw he two vectors of V, (or V,). Prove that 

(a) Jatv|<jul+jy| 

(b>) [w-v}= [ul |v | if wis parallel to v. 
Let w be orthogonal to both y and w. Then prove that w is orthogo- 
nal to each vector of the set {av + Bw | a, 6 any real numbers}. 
True or false ? 

(a) w+» = Oimplies eithera = Oorv = 0, 

(b) Ifw-v = Oforally € V,, thenz = 0. 

(c) w- (vy + w) is meaningless, 


2.4 APPLICATIONS TO GEOMETRY / 55 


(d) (& - v)w is a vector parallel to w. 

(e) In space ifu-j = Oandu-k = 0, thenaw = i. 
(f) (1, ~—1)- (—1, 1,0) = 0. 

(gz) [wl = Oifu = 0. 


2.4 APPLICATIONS TO GEOMETRY 


The main applications that we consider in this article are equations to 
lines and planes and certain associated problems. First, we shall work out 
a few examples to illustrate the power of vector methods. 


Example 2.22 In trigonometry, the formula 
cos (8 — 6) = cos § cos d + sin Osin ¢ 
is fundamental. We shall prove this formula by using vectors. 


—> —> 
Proof: The unit vectors OQ and OP (see Figure 2.19) at angles 9 and ¢ 


FiGuRE 2.19 


with the positive direction of the x-axis are respectively 
cos 0i + sin 8f and cos di + sin dj. 


mae —> 

The angle 8 — } between the vectors OQ and OP 1s given by 
— +, 
OP - 02 
—> —> 

| OP| | 9Q| 
Example 2.23 Prove, by using vector algebra, that the three altitudes of 
a triangle are concurrent. 


Proof: Let AD and BE be the two altitudes of a triangle ABC, meeting 
at the point O (see Figure 2.20). It 1s sufficient to prove that CO 1s 
perpendicular to AB. 


cos (08 — >) = = cos @cos d + sinOsin >. 


Clearly, 
—_> —_ 
AO - BC = 0, 
and ee 
BO-CA = Q. (1) 
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A 
E 
B 0 Cc 
FiGure 2.20 


Note that we are working with vectors that do not have the same 
initial point. Now 


_> —_— —> _> —_—-> 
CO. AB = CO - (AC + CB) 
—> —_—>- — —> 
= CO-AC+ CO: CB 
— —_ —_ —_ — —_ 
= (CB+ BO)- AC + (CA + AO): CB 
—_ —> _> —— —_> —-— “> -—> 
= CB-AC+ BO-AC+CA-CB+ AO> CB 
_—_> — _> —> 
= CB-AC+CA-CB (by (1)) 
-_> -> —_> — _> —_—> 
= CB- AC —AC:+CB (because CA = —AC) 
— <> —_> — 
= CB-AC—CB-AC=0 (by 2.3.5 (c)). 


We shall now take up the standard applications of vectors to equations 
of lines and planes in analytic geometry. First, we note that if P (x;, y,) 


7 

and Q(x., Ys) are two points in a plane, then the vector PQ is given by 
—> > —> : . 
PQ = OQ — OP = (X5 —— Xi Ve — Ys) = (Xe — x,)i + (ve — wy ° 

Similarly, if P(x, y,, 2;) and Q(Xq, Ye, Z,) are two points in space, then 

the vector PQ is (x, — x1)i + (vg — Yidj + (2s — %)k. 

2.4.1 The Equation of a Straight Line 


Consider a straight line L parallel to a vector w and passing through 
a point P (Figure 2.21). 


FIGURB 2.21 
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Let Q bea pointon Z. The vector r = OG (0 is the origin) is called 
the position vector of point Q. Let w be the position vector of point P. 
Then 
r= 00 = OP + PO 

vy + a vector parallel to » 

=w+ in, (2) 
where ¢ is a real number, This equation is satisfied by all points Q on the 
line and by no points off the line. (Why?) It is called the vector equa- 
tion of a straight line through a given point P and parallel to a given 
vector w. The following special cases are worth noting. 


2.4.2 Line in a Plane 


Let P be the point (x,, y,) and w be the vector (a, 5). Then » = OP 
= (X,, yi) andr = OQ = (x,y). Then the equation of the line takes 
the form 

(x, y) = (x1, ¥:1) + (a,b) = (x, + ta, y, + tb). 

This equation can be written as a pair of equations : 

x=%A+la y= yt tb, 
i.e. (x —x,) = ta, (y— yy) = 10. 
These are called the parametric equations of the straight line. Eliminating 
t, we get the cartesian equation 

a(y — y;) = B(x — x). (3) 

Ifa = Oor db = 0, vector wu becomes a vector along one of the coordi- 
nate axes and the line has the equation x = x, ory = ),. 


Ifa # 0 and b + 0, Equation (3) may be written in the symmetric 
form as 


x—*x ‘y- 
a = yo . (4) 
If uw is a unit vector at an angle 0 (+ 7/2), thenw = (a,b) = (cos 0, 
sin 6). Hence, Equation (3) may be written as 
y— y, = tan 9 (x — x,) 
or 
y-—yY, = mx —x,), (5) 
where m is the slope of the straight line L. Thus (5) is the equation of 
the straight line through P(x,, y,) and having slope m. 
Thus, given a vector, we have found the equation to a straight line 


parallel to the vector. The converse situation is contained in the follow- 
ing example. 
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Example 2.24 Let ix + my +n = 0 be the equation of the straight 
line Z in a plane. Then the vector —mi-+ i is parallel to L and the 
vector /i + mj is perpendicular to L. 


Case l n= 0. 
If either /= 0 or m = 0, then the straight line Z 1s parallel to one 


of the coordinate axes and the result 1s true. 
Now suppose that / ~ 0 and m = 0, In this case the two points 


= n., n 
P(—n/i, 0) and Q(0, —n/m) lie on LZ. The vector OP 1s — 7! + po 


lm — ap ; 
The vector 3 QP 1s parallel to the vector QP and hence to the line 
L. This vector is —mi + J. 


ae 
The vector 4i + mj 1s perpendicular to the vector QP and hence to the 
line L, because 


55s hast Ris ge Me ee. - 
(i + mj) aioe oan eo J)=—-n+n=— 0. 
Case 2 n = 0, 


Shift the line /x + my = 0 parallel to itself and obtain /x + my 
+n’ = 0, n’ 40. Using Case 1, we get the desired result. 


2.4.3 Line in Space 
Let P be the point (x,, y,, Z,) and w be the vector (a, ),c) Then 


—> 
y= OP = (x4, Vis Z,) 
and = (x, Vs Z) = (X;, Vis Z:) = t(a, b, ¢) . 
r= (x,) is the position vector of any point Q onthe line L. This 
vector equation may be written in the parametric form 
x=X,4¢ ta; poy+t; 2=>24+ Ite. (6) 
Eliminating ¢, we get the symmetric form 
4—%y IN ng 2A 
b c (7) 
provided a, b, and c are nonzero. Thus, we get another form of the equation 
of a straight line through P(x,, ¥1, 2,) and parallel to the vector 
w= ai + bj + ck. 

If any two of the numbers a, b, c are zero, say a = b = 0, then the 
vector # = (0, 0, c) becomes a vector along the z-axis. The equation of 
the straight line, from Equation (6), is 

XX, Y= Vy (8) 
Note that these two together represent the straight line. 
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If just one of the numbers a, b, c is zero, say a = 0, then w# is the vector 
bj + ck. The equation of the straight line, from Equation (6), is 


yo es <—4.. (9) 


These two together represent the straight line. 


X= Xi; 


2.4.4 Direction Cosines 


—> 
Let a, B, y be the inclinations of the vector # = OA = (a, b, c) to the 
positive directions of the coordinate axes OY, OY, OZ, respectively, as in 
Figure 2.22. Then cos «, cos B, cos y are called the direction cosines of 


f 


— 
SS 
= 
aS 


Ty 


Se 
——— 


FIGURE 2,22 


the vector u = ai + bj + ck. These are also called the direction cosines 
of a line parallel to w and in the same direction as wu. The ordered set 
{cos «, cos B, cos y} is called the set of direction cosines of the line re- 
presented by vectors. Clearly, 


cos @&@ = we = eg ee (10) 
jul lil Vite +c 
eed uj a. ee 
co P= Tall] ~ Vato — 
u-k Cc 
8S THR VERT = 


It follows that cos* « + cos? 8 + cos* y = 1. For any real number 
k, the ordered set {k cos a, k cos 8, k cos } is called the set of direction 
ratios of a line parallel to w. Clearly, a, b, c are the direction ratios of the 
line parallel to the vector ai + bj + ck and hence of the line 


ee Re ee WD 
a b c 
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2.4.5 The Equation of a Plane 
Consider a plane passing through a point O(%;, ),, Z,) and perpendi- 
cular to a vector# = OA =: (a, 5, c) (see Figure 2.23), Let P(x, y, z) 


FIGURE 2.23 


be a point in the plane. Then the vector OP = (x — xi + (y—y)j 
+ (% — 2,)k lies in the plane and is perpendicular to the vector u = ai 
-+ bj + ck. Therefore, 


which gives 
a(x — x) + b(y— yy) 4 e(z—z,) = O. (13) 


This 1s satisfied by all points P on the plane and by no points off the 
plane. Equation (13) 1s called the equation of the plane through Q(x,, y,, 2;) 
and perpendicular to the vector # = (a, 5, c). 


Equation (13) of the plane can further be simplified to the form 
ax+bytezitd=0, 


where d = —ax, —by, —cz,. Thus, the equation of a plane in space ts 
a linear equation in x, y, and z. Conversely, consider a linear equation 
Ax+ ByiCz+D=0, (14) 


where A, B, and C are not all zero. Let 4 + 0. Then wecan write 
Equation (14) as 


D 
A(x + 7) 4. Bry — 0) + C(z—0) = 0, 
which 1s the equation of a plane through the point (— D/A, 0, 0) and per- 
pendicular to the vector Ai + Bj +Ck. 


Two planes, if not parallel, intersect in a straight line. Thus, a straight 
line may also be considered as the intersection of two planes, and hence 
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its equation may also be given as a pair of equations of planes, e.g. 
ax+ by +eaqz+da = 0 
and a,x + by + 2 +d, = O 
represent a line. From these equations, we can get the equation of the 
line in the symmetric form 
RT A ee PI oe 
a 
We illustrate this by the following example. 


Example 2.25 Find the symmetric form of the equation of the line of 
intersection of planes 
x-+3y— z+5 =0 (15) 
and 5x—2y+4z—8 = 0. (16) 
Eliminating 2 from the two equations, we get 
9x + 10y + 12 = 0 


or 9x = —10y — 12. 
Eliminating x from Equations (15) and (16), we get 
2, 32 e 
ES 
90z 126 
So, we get 
90z — 126 
9x = —10y 12 pomees |, haa 
a X-0 © y+65 _ 2-715 
1/9 —1/10 — 17/90 
oe x-O  ytO6/S 2-75 
—10 — 9 “47 
Problem Set 2.4 
1. Prove by vectors that the diagonals of a rhombus meet at right 
angles. 


2. Prove by vectors that the line segment joining the midpoints of two 
sides of a triangle is parallel to the third side and its length is one-half 
the length of the third side. 


3. Find the direction cosines of the line passing through the points 
A(1, 2, 1) and B(3, —1, —}). 

4. Find the vector equation of the line passing through two given 
points. cae an es 

5. Prove that the points A, B, C are collinear iff OC = «OA + BOB, 
wherec + 6 = 1. 
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6. Prove that the perpendicular distance from the point P to the line 


10. 


11. 


13. 


14. 


OP —> 
r= py + fy is |» + (OP —v)- 4, _ op|. 
UU 
Find the angles between the lines 
ee 2 SO Be 8 Va ee 
i a [’ m’ n' 


Find the angles that the vectora = 2: — 2j + & makes with the 
coordinate axes. 
Find the equation of the plane perpendicular to the vector # = 2i 
+ 3j + 6k and passing through the terminal point of the vector 
i+ Sj + 3k. 
Determine a vector perpendicular to the plane containing the vectors 
u = li— 6f— 3k and vp = 45+ 3j - k. 
Find the angle between the planes 
(a) 2x -~y+2z = landx—y = 2 
(b) 3x + 4y — 5z = 9 and 2x + 6y + 62 = 7. 
Prove that tfe distance of the point P,(x9, Yo, 2) fiom the plane 
ax + by +cz+d = Ois 
| axyp + byy +c%td| | 
V+ B+ ct 
Prove that the equation of the line of intersection of the planes 
4x + 4y — 5z = 12 and 8x + 12y — 13z = 32 can be written in 
the form 
PE at ee 1 
2 #43 
Prove that the equation of the sphere of radius r with centre 
P(X1, Yip %1) 18 (X — %)? + (CY — Y,)? + — AP = 7’. 


Chapter 3 


Vector Spaces 


In Chapter 2 we saw that the set of all plane (space) vectors forms a 
commutative group relative to addition and, further, relative to scalar 
multiplication it satisfies certain properties (Properties 2.2.7). All these 
properties of vectors are so fundamental in mathematics that whenever 
any system satisfies them we give it a special name, namely, vector space. 
The precise definition of a vector space follows. 

‘ 


3.1 VECTOR SPACES 


3.1.1 Definition A nonempty set V is called a real vector space (or a real 
linear space or a real linear vector Space) if the following axioms are 
satisfied : 

VS1 There is a binary operation ‘+’ defined on V, called ‘addition’, 
VS2_ There is a scalar multiplication defined on V. (This means, to 
every real number a and every element uof V, we tan associate a 
unique element of V and denote it by aw ) 

VS3 Addition and scalar multiplication satisfy the following : 

(a) V is a commutative group for addition (i.e. Gl, G2, G3, and G4 
hold for addition in V). 

(b) a(u + v) = au + av and (@ + B)u = au + Bu for all real 
numbers «, 6 and allu, v € V. 

(c) a(@u) = (aB)u = Bou) for all real numbers a, B and all 
uc V. 

(d) lu = uforallu c€ V. 

3.1.2 Remark A complex vector space is defined analogously by using 
complex numbers instead of real numbers in Definition 3.1.1. * 

31.3 Remark The real or complex numbers used for scalar multiplication 
in the definition of a vector space are called scalars.. Throughout 
we shall deal with only real vector spaces and complex vector 
spaces. 
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In Chapter 2 we saw that V, and V, have addition and scalar multipli- 
cation defined on them and VS3(a) holds for addition in both (Theorem 
2.2.5); and that (b), (c), and (d) of VS3 hold for scalar multiplication in 
V, and V, (Properties 2.2.7). Since these properties of plane vectors and 
space vectors have been abstracted to provide the general definition of a 
vector space, we shall hereafter use the word ‘vector’ to mean ‘an element 
of a vector space’. In other words, elements of a vector space shall be 
called vectors. Plane vectors and space vectors are only specific cases. 
3.1.4 Remark Note that here we have not used 4, v, w for denoting 

vectors as we did in Chapter 2. We shall consistently use the letters 
u,v, W, ... for vectors, and the Greek letters a, B, y, ... for scalars. 
However, we use the boldface 0 to denote the zero vector of the 
space to distinguish it from the scalar ‘zero’. 

Clearly, V, and V, are vector spaces. There are many other examples 
of vector spaces. We shall note a few of them here. In fact, the reader 
should be able to visualise several vector spaces before we go deeper into 
the subject. Visualisation of a vector space involves five steps : 

(i) Consider a nonempty set V. 

(ii) Define a binary operation on V and call it ‘addition’. 

(iii) Define scalar multiplication on V as described in VS2. 

(iv) Define equality in V. 

(v) Check whether (a) to (d) of VS3 are satisfied relative to the 
addition and scalar multiplication thus defined. 


Example 3.1 Let V, be the set of all ordered n-tuples of real numbers. 
Thus, an element of V, would be of the form (x,, x3, ..., X,), where the 
x,’s are real numbers. Define addition, scalar multiplication, and equality 
in V,, as follows : If u == (X,, Xe, .... Xn) and V = (),, Yo, ..., Yn) are two 
elements of V,, then : 
Addition 
uty = (x, + VW Xq t+ Vay oy Xn + Ya) ° (1) 
(Note that u + v € V,, because the right-hand side of Equation (1) is an 
ordered n-tuple of real numbers. This is called coordinatewise addition.) 
Scalar multiplication For a real scalar a, au is defined as the ordered 
n-tuple (ax,, @Xg, .., &X,), 1.€. 
w= (ax, Xe, eoey aX) 9 (2) 
which is again in V,. (This is called coordinatewise scalar multiplication.) 
Equality u = (xy, x4, ...5 Xn) and v = (J,, Va...» Ya) are defined as 
equal if x, = y,i = 1,2,...,m 
Since addition, scalar multiplication, and equality in V, have been 
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defined, what remains is to check whether (a) to (d) of VS3 are satisfied. 
We shall leave most of this checking to the reader. However, in order to 
give him an idea of what such checking involves, we shall now go through 
some of the details. 


Commutativity of addition 
Let u = (%4, X9, ..., X,) and v = (Jy, Ya, ...) Yn) be two members of Vg. 
Then u-+y = (x, + Vis Xg + Vay > Xn t Ya) 
and Vt u = (Vy + Xy. Ve + Xay «00s Vn + Xn) - 
The real numbers x, -+- y, and y, + x, are equal, since the commutative 
law of addition holds for real numbers. As this argument is true for 
every k, it follows from the definition of equality that u+v = v + u, 
The alert reader would have now noted that, fundamentally, it is the 
commutative law of addition among real numbers that gives the commuta- 
tive law of addition in V,. If this fact is remembered, we can check that 
uty = v-+ weven mentally. 


Existence of additive identity 

We have to determine an element 0, which has the property 
0+u=— u. In this case we find that 0 = (0, 0, .... 0), because 
(0, 0, ..., O) + (X1, Xe, -- 5 Xn) = (Xy, Xe, «2.5 X_) for all (X,, Xg, .... Xn) 
€ V,,. 


Existence of additive inverses 

Here we have to determine an element —wu for the vector u €’ V, such 
that —u + u = 0 = (0,0,..., 0). If u = (x, Xe, ..., X,), then we can 
easily see that —u = (—x,, —Xq, ...) —Xn). 

We assume that the reader can check the remaining properties. Once 
(a) to (d) of VS3 are checked, it follows that V,, for the addition and scalar 
multiplication defined 1n (1) and (2), is a vector space. 

It may be noted tbat, by Theorem 1.6.3.0 = (0, 0, ..., 0) is the unique 
zero of the space and —u = (—x,, —Xs, .... —Xn) is the unique negative 
Of wu = (Xj, Xe, ..-» Xn): 

Thus, V,, isa real vector space, since we have used only real scalars. 
Can we use complex scalars in this case? No. “For, suppose « is a 
complex number. Then av = (ax, &Xq, .., &X,) is not in Vy, because 
the numbers «x, are complex and V,, contains only n-tuples of real numbers; 
so scalar multiplication is not defined. See, however, Problem 2. 

The special cases m = 2andn = 3 of Example 3.1 give us the vector 
spaces V, and V,. The special case m = 1 gives the space V;, which is 
nothing but the space of real numbers, where addition is the ordinary 
addition of real numbers and scalar multiplication is the ordinary multi- 
plication of real numbers. 
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Example 3.2 Let ¥(J) be the set of all real-valued functions defined on 
the interval J. With pointwise addition and scalar multiplication (cf § 1.7), 
a (f) becomes a real vector space. The zero of this space is the function 
0 given by 0(x) = 0 for all x € J. 

Example 3.3 If, instead of the real-valued functions in Example 3.2, we 
use complex valued functions defined on / and pointwise addition and 
scalar multiplication, then we get a complex vector space (using complex 
scalars). We denote this complex vector space by §c(J). 

Example 3.4 Let Y(t) denote the set of all polynomials p with real 
coefficients defined on the interval J. Recall (cf Example 1.39) p is a 
function whose value at x is 


P(x) = & +a,x+... + a,x" forall x € J, 
where «,’s are real numbers and 7 is a nonnegative integer. Using point- 
wise addition and scalar multiplication as for functions, we find that (7) 
is a real vector space. If we take complex coefficients for the polynomials 
and use complex scalars, then we get the complex vector space fc(/). In 
both cases the vector 0 of the space is the zero polynomial given by 
O(x) = O for allx € J, 


NOTATIONS 


EG (a, 6) = the set of all real-valued functions defined and conti- 
nuous on the closed interval [a, 5]. 

A (fa, 5] = the set of all real-valued functions defined on [a, 5] and 
whose first derivatives are continuous on [a, 5]. 

& fa, b] = the set of all real-valued functions defined on [a, 5}, 
differentiable m-times and whose n-th derivatives are 
continuous on [a, b]. These functions are called n-times 
continuously differentiable functions. 

Example 3.5 ¢[a, bl, & “'la, 6), ¥Y “Ia, b) are real vector spaces under 


pointwise addition and scalar multiplication. We have to use the fact from 
calculus that the sum of two continuous (differentiable) functions is conti- 
nuous (differentiable) and any scalar multiple of a continuous (differenti- 
able) function 1s continuous (differentiable). 
By changing the domain of definitions of continuity and differentiability 
to the open interval (a, b), we get, similarly, the real vector spaces ¥ (a, b) 
and ¥ ‘)(a, 6) for each positive integer n. 
3.1.5 Remark By changing real-valued functions to complex-valued func- 
tions and using complex scalars, we get the complex vector spaces 
F cla, b] and ¥ c(a, db). 
3.1.6 Remark In each of these cases the reader should convince himself 
that the sets concerned are ‘vector spaces’ under the definitions 
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mentioned. He should check the axioms in each case until he reaches 
the stage where he can quickly say whether the axioms are Satis- 
fied or not. In any case no axiom should be taken for granted. In 
all cases the zero element of the space and the negative of any given 
element of the space should be clear in the reader’s mind. 


Example 3.6 Let G’ ‘fa, b] stand for the set of all functions defined 


on [a, b} and having derivatives of all orders on [a, 6]. This is a real vector 
space for the usual operations. It 1s called the space of infinitely differenti- 
able functions on fa, b}. 


We conclude this article with a theorem giving certain immediate conse- 
quences of the definition of a vector space. Recall that, in the definition 
of a vector space, we have property (d) of VS3, namely, |v = yu for all 
u€ V. It should be noted that this apparently trivial axiom is crucial’to 
the development of the theory of vector spaces. 

3.1.7 Theorem /n any vector space V, 

(a) «0 = 0 for every scalar «. 

(b) Ou = 0 for everyu E V. 

(c) (—1l)u = —u foreveryuc V. 

Proof: (a) «0 = «(0 + 0) (by G2) 

== 20 + a0 (by VS3(b)). 
Adding —(«0) to both sides, we get 
0 = —(«0) + («0 + a0) 


= (—(«0) + («0)) + «0 (by Gl) 
= 0+ 20 (by G3) 
= 20 (by G2). 
(b) Ou = (0+ 0)u = Ou + Ou (by VS3(b)). 


Adding —(0z) to both sides, we get 
0 = —(Ou) + (Ou + Ou) = (--(Ou) + (Ou)) + Ou (by G1) 


= 0 + 0u : (by G3) 

= Ou (by G2). 
(c) (—-l)hutu = (—l)u t+ lu (by VS3(d)) 
= (—1 + lu (by VS3(c)) 

= Ou = 0 (by (b)). 


So by G3 and the uniqueness of the negative, (—1)u is the negative of u, 
i.€. (— 1) = —*, & 


It is convenient to write 4 — v for u + (—yv). 
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1. 


Problem Set 3 1 


Let n= (1, 3,2, 7), ue = (0, 2, —3, 5), “= (—1, 3, 1, -- 4), and 
u, = (—2, 16, —1, 5) be vectors of V,. Then evaluate 
(a) u,+u (b) 2u, + 3u,— Tu, (C) uy + 2uy + Jug — % 
(d) 3, + (uy—u,) (e) (au,—bu,) + aus. 
Consider the set V€ of all ordered n-tuples of complex numbers. By 
defining equality, addition, and scalar multiplication (with complex 
scalars) as in VS, prove that V© is a complex vector space. Is it a real 
vector space ? 


Let Rt be the set of all positive real numbers. Define the operations 
of addition and scalar multiplication as follows : 
u+y=u-yv  forallu,v € Rt 
au == ut for all w © Rt and real scalar «a. 
Prove that R* 1s areal vector space. 
Which of the following subsets of V, are vector spaces for coordinate- 


wise addition and scalar multiplication ? 
The set of all vectors (x,, X2, %3, X,) € V,such that 


(a) x = 0 (b) x, = 1 (c) x, >0 
(d) x3 >0 (ec) xi <0 (f) 2x, + 3x, = 0 
(g) x, + $x, — 3x, +x, = 1. 

In any vector space prove that cu = Q ifeithere = 0 or u = Q, 


Which of the following subsets of ? are vector spaces ? 
The set of all polynomials p such that 


(a) degree of p << » (b) degree of p = 3 
(c) degree of p > 4 (d) p(i) = 0 
(e) p(2) = 1 (fF) pl) = 0 


(g) p has integral coefficients. 
Which of the following subsets of 7 (0, 1] are vector spaces ? 
The set of all functions f € ¢¥7[0, 1] such that 


(a) fQ/2) = 0 (b) f(3/4) = 1 
(c) f'(x) = xf(x) (d) f(0) = fil) 
(e) f(x) = 0 at a finite number of points in [0, 1] 
(f) J bas a local maxima at x = 1/2 
(g) jf has a local extrema at x = 1/2. 


Let V be a real vector space and X an arbitrary set. Let V¥ be the set 
of all functions f: X-> V. Prove that V* is a real vector space for 
pointwise addition and scalar multiplication, where definitions are 
analogous to those for real-valued futctions. 
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9. True or false? 
(a) In a vector space V, (—1)(—u) == uforailu c€ V. 
(b) Ina vector space V, --u — v = —vy —uforallu,v€ V. 
(c) In a vector space V, -u — v = —(u-+ v} forallu,v € V. 
(d) Ina vector space V, —(—u) = uforalluc V. 
(e) RX R18 a vector space. 


(f) If the scalars are complex numbers, then ¥(/) 1s a complex vector 
space. 


(g) In C, the set of complex numbers considered as a complex vector 
space, if«e-1-+ @: = 0,thena = 0 = 86. 


3.2 SUBSPACES 


3.2.1 Definition Let S be a nonempty subset of a vector space V. S is 
said to be a subspace of V if Sis a vector space under the same 
Operations of addition and scalar multiplication as in V, 

‘In order to understand this definition as well as the future concepts in 

the subject, we shall repeatedly consider the concrete cases of V, and V,. 


V, 1s the Euclidean plane. Take any straight line S through the origin 
— 

O. Any point P on this straight line cans be considered as a vector OP of 

V,in S. The sum of two such vectors OP and 00. where P and Q both 


lie in S, is again a vector OR, where R lies in S. Similarly, a scalar multi- 
ple of any vector in S 1s again a vector in S. All other axioms of a vector 
space are automatically satisfied in S. So S is a vector space under the 
same operations as in V,. Thus, S is a subspace of V,. In other words, every 
line through the origin is a subspace of Vy. 


In the same manner, in V, we find that any plane S_ through the origin 
1s a subsfiace of V;. Also, every straight line L through the ongin 1s a sub- 
space of V;. The following examples further illustrate the concept of a 
subspace. 

Example 3.7 Let L be the set of all vectors of the form (x, 2x, —3x, x) 
in V,. Then L is a subspace of V,. 


Proof: If u = (x, 2x, —3x, x) and v = (y, 2y, —3y, y) are two elements 
of L, then clearly 


Uv = (x+y, x + y), —Hx + y), * + Y) 
and au == (ax, 2(xx), —3(ax), %x) 
also belong to L. The zero element (0, 0, 0, 0) 18 also of this form and 
hence belongs to L, The negative of uis —u = (—x, ~2x, 3x, —x), 
which is again of the same form and hence belongs to L. The other laws 
of associativity and commutativity for addition, distributive laws, and the 
final axiom lu = w are all true in L, because elements of L are elements 
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of V,, and in V, all these laws are true. Thus, Z is a subspace of Y. Tm 
fact, L is the ‘line’ through the point (1,2, —3, 1) and the origin 
(0, 0, O, 0) in VY. 
Example 38 Generalising Example 3.7, we can say that all scalar multi- 
ples of a givea element u, of a vector space V form a subspace of V. 
Proof: Let the set of all scalar multiples of u, be denoted by [uo]. If # and 
v afe two vectors in [u,], then « = au, for some « andv = Bu, for 
some 6. 

u-+y = au, + Bug = (a + B)um, ie. w+ v is a scalar multiple of 
uM. Hence,u+v € [uw]. Again, Ad = Alau,) = (Ax)u, ie. Au is also 
a scalar multiple of u,. Hence, Au € [u] for all scalars A and u € [w,]. 

0 € [u,], because 0 = Ou, by Theorem 3.1.7. If u € [up], then 
—u = (—1)u by Theorem 3.1.7, and so —u € [wu]. The other axioms, 
which are only interrelations, are true for all elements of V and so are 
true for all elements of [ug]. Hence, [u,] is a subspace of V. 

Example 3.7 is a special case of Example 3.8. The subspace of Ve 
considered in Example 3.7 is just ((1, 2, —3, 1)]. 

In these examples we note that to prove that S is a subspace of V we 
explicitly checked only the following : 

(i) The sum of any two vectors in S is again in S, i.e. addition is 
closed in S. 

(ii) The scalar multiple of any vector in S is again in S, i.e. scalar 
multiplication is closed in S. 

(iii) The existence of 0 in S and the existence of a negative for each 
element in S. 

The other axioms were not explicitly checked, because this, as the 
following theorem shows, was not necessary. In fact, the theorem says 
that even (ill) need not have been checked. 


3.2.2 Theorem A nonempty subset S of a vector spuce V is a sc of 
V iff the following conditions are satisfied : 
(a) Ifu,v € S, thenu+veE S. 
(b) Ifu € Sandaa scalar, then au € S. 


In other words, a subset S of a vector space V is a subspace of V if it 
is closed under addition and scalar multiplication defined in V. 


Proof: Let S be a subspace of V. Then S is a vector space under 
the same operations as those of V. Hence, S Satisfies (a) and (b). Con- 
versely, if (a) and (b) are satisfied, then we have to prove that S satisfies 
all the axioms of a vector space. VS1 and VS2 are satisfied for S, 
because this is exactly what (a) and (b) say. We shall now show that 
VS3 for S follows from VS1 and VS2 for S. 
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Ou = 0 for any « € Vand therefore for any 4, © S. Taking any 
uo G&S, we see that, from (b),0 = Ou, € S. Similarly, (—1)“4 = —w 
for any u € V and therefore also for a givenu, € S. Hence, —u, € S 
for every U% © S. Thus, G2 and G3 hold in S. 

Axioms G1, G4, and (b), (c), and (d) of VS3 are automatically satisfied 
for elements of 5S, since these laws already hold for elements of . Note 
that this needs no checking, because these axioms are interrelations of the 
elements. In the cases of G2 and G3 the checking was necessary, because 
we had to show the existence of certain elements in S. §j 
3.2.3 Remark In view of Theorem 3.2.2, whenever we want to prove 

that a set S for certain operations 1s a vector space, we try to look 
at S as a subset of V, where V is a vector space and the operations of 
addition and scalar multiplication in S are the same as the opera- 
tions in V. Once we have done this, it is enough to prove that the 
operations are closed in S. 
Example 3.9 Take ¢&[a, b] of Example 3.5. % [a, b] is a subset of 
Fla, bj], which is a vector space by Example 3.2. So to prove that 
6 [a, 6] is a vector space (which we have done in Example 3.5), it is 
enough to prove that G [a, 5] is a subspace of F[a@, 6]. Therefore, by 
Theorem 3.2.2, we only need to prove that ‘47 [a, 6] 1s closed for addition 
and scalar multiplication. 

Since the sum of two continuous functions is continuous and any 
scalar multiple of a continuous function is again continuous, we find that 
addition and scalar multiplication are closed in % [a, b]. This observa- 
tion not only proves that ¢ [a, b] is a vector space, but also that it is a 
subspace of § [a, 5]. 

3.2.4 Remark The spaces “[a, 5], 6°“ [a, 6], 4’ (™[a, 5], and P[a, 5] 
are subspaces of $[a, 5]. 
Further, note that 
(a) P[a, b] is a subspace of Y [a, 5]. 
(b) Ya, b] is a subspace of Y?,a, 5). 
(c) Ya, b] is a subspace of ¢ [a, b] for every positive integer n. 
(d) ¢7™ a, b] is a subspace of 4°(™{a, b] for every m <n. 
(e) J[a, b] is a subspace of Y ™[a, 5) for every positive integer 7. 
(f) Similar results are true for functions defined on (a, 5). 
Example 3.10 The set S of all polynomials p € 2, which vanishes at a 
fixed point x,, is a subspace of ?. 

We have S= {pe P| p(x) = 0}. 

If p and q are two members of S, then p(%)) = 0 and q(x) = 0. So 
(p + @)\(X%o) = P(X—) + GX) = 0, which means that the polynomial 
P + q also vanishes at x9 and sop + q€ S. So addition is closed in S. 
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Similarly, if « is a scalar and p € S, then (ap) (xo) = a(p(x))) = «- 0 = 0. 
So ap € S. This completes the proof that S is a subspace of #. 

Before concluding this article, we shall identify what are called trivial 
subspaces of a vector space V. The set containing just the zero element 
of V and nothing else is clearly a subspace, since it satisfies conditions (a) 
and (b) of Theorem 3.2.2. Similarly, V, itself considered as a subset of V, 
satisfies the conditions of Theorem 3.2.2 and so is a subspace of itself. 
These two subspaces {0} and V of ) are called trivial subspaces of V, since 
they trivially satisfy conditions (a) and (b). All other subspaces of V are 
called nontrivial subspaces of V. The trivial subspace {0} of V is denoted 
by V, and is also called the zero subspace of V. 

Example 3.11 Consider the equation 

OX, + OgX_ + .. + a,X, = O. (1) 
where «,’s are real constants and x,'s are real unknowns. A solution of 
this equation can be represented as an n-tuple (x,, Xs, ..., X,), Which is a 
vector of V,. Now let S be the set of all vectors (%), Xo, .... Xn) E Vy, 
which satisfy Equation (1). We can prove that S is a subspace of V,. The 
proof is left as an exercise for the reader. 

The special cases of Example 3.1, when n = 2 orn == 3, are interest- 
ing. Take V,. The set S of vectors (x, y) € V,, which satisfy the equa- 
tion ax + By = 0, is clearly a straight line through the origin in V,. 
It is therefore a subspace of V,, as pointed out in the discussion following 
Definition 3.2.1. This is now corroborated by the general case considered 
in Example 3.11. 

Again, in V, the set Sof all vectors (x, y, z) € V3, which satisfy the 
equation ax + By + yz = 0,18 a plane through the origin and hence a 
subspace of V, (also explained in the discussion following Definition 3.2.1). 
This fact is now corroborated by the result in the general case. 


Finally, suppose in V, we consider the set S of all vectors (x, y, z), which 
satisfy the equation ax + By + yz = 1. This, of course, is a plane, but 
since it does not contain the vector (0, 0, 0), the zero of the space, it is not 
a subspace. 


From the foregoing argument we can see that to prove that a given set 
is not a subspace (when it is not !) is really easy. For, from among the 
several axioms that it has to satisfy we choose one that is not satisfied by 
it and we are done. For example, in the previous paragraph, it is obvious 
that (0, 0, 0) does not belong to the set and this observation alone is 
enough for us to conclude that the set is not a subspace. 


Problem Set 3.2 


1. Prove that conditions (a) and (b) of Theorem 3.2.2 can be replaced 
by the single condition 
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au + By € S for all u,v € S and all scalars a, 8. 


2. Let W = {(x,, Xg, ....%n) € Va | x, = 0}. Prove that W is a sub- 
space of V,,. 


3. Prove that 
W = {(x1, Xo, ee y Xa) = Ve | yxy + AgX2 ++ ene + ay Xen = 0, 


a,’S are given constants} 
is a subspace of V<. 


4. Which of the following sets are subspaces of V,? 
(a) {(1, Xp, %3) | 44%, = O} 
(b) {(x1, 2, X3) | = = f2} 
(C) {(%y, Xp. X9) | 2x, = V3XQ} 
(d) {(x1, X,, x5) | x5 18 an integer} 
(e) (0%), x, x5) | x3 +43 +23 <1} 
(f) {(5¢a, Xg, Xg) | Hy + Xy + Xa > O} 
(g) (0%, a, %3) | %) = V2, and x, = 3x9} 
(hb) {(%, Xg, Xg) | 4; = 2x, or X3 = 3x,} 
3X, 
sees > 3 . 
5 Which of the following sets are subspaces of :f ? 
(a) ip € # | degree of p = 4} 
(b) {p & # | degree of p < 3} 
(c) {p € # | degree of p > 5} 
(d) {p€ # | degree of p ~ 4 and p’(0) - 0} 
(e) jpE Pl pl) = O}. 
6. Which of the following sets are subspaces of ~’ (a, 5)? 
(a) {FE % (a, b) | f(x) = 9, x, € (a, b)} 
(b) {fE Z% (a,b) | f(x) = 0 for all x € (a, b)} 


© FE ¥ ab) (tt) =H 


2 
(dd) {fE Gah fm = x f(x} 
(e) {FE G7 (a, b) | 2%) + 3xf"(%) — F'(%) + f(x) = 0} 
(f) {fE F(a, b) | fas(x)dx — 0}. 
7, Prove the statements in Remark 3.2.4. 


8. (a) If U and W are subspaces of a vector space b’ such that U C- W, 
then prove that U is a subspace of JV. 
(b) If W is a subspace of a vector space V and U is a subspace of W, 
then prove that U is a subspace of V. 
9. True or false ? 
(a) In V, every infinite subset is a subspace. 


(1) {(X, Xp. X,) |X, — 2Xy = Xy 
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(b) V, is a subspace of V3. 

(c) V, X Vg = V5. 

(d) Every subspace of a vector space is a vector space. 

(e) V, is the only real vector space containing a finite number otf ele- 
ments. 

(f) The derivatives of e* form a vector space. 


(2) The set {x sinx + Bcos x| «a, are real numbers} is a vector 
space. 


3.3 SPAN OF A SET 


In Example 3.8 we saw that an element uw of a vector space V gave rise 
to a subspace [u] of V. Looking at it another way, we can say that here 
is a subspace of V, namely, [uo], that is fully identified once we know the 
single element uw. Jn this article we shall see subspaces that are fully 
identified by a subset of V, which is smaller than the subspace. To be more 
precise, we need the following definitions. 

3.3.1 Definition Let u,, u,, .., U4, be m vectors of a vector space V and 
let «,, %, ..., %, be m scalars. Then 
Mit, + Agtly + ... + Ayn 
is called a linear combination of u,, ts, ..., Up. It is also called a linear 
combination of the set S = {t,, Ug, ..., U,}. This being a linear combi- 
nation of a finite set is also called a finite linear combination 

In the case of an infinite set S a linear combination of a finite subset 

A of S is referred to as a finite linear combination of S. 


3.3.2 Definition The span of a subset S of a vector space V is the set of 
all finite linear combinations of 5. 
In other words, if S is a subset of V, the span of S is the set 
M1, Oy. oy %y, ANY SCalars, 2 any posi- 
Jat Se Ra he iar ae tive integer, and 4,, ts, ..., - Z Sf- 

The span of S is denoted by [S]. If S contains only a finite number of 
elements, say 4, Us, ..., Uy, then [S] is also written as [t, us, ..., Up). 

As illustration, take V = V, and S = {(1, 0, 0), (0, 1. 0)}. Any linear 
combination of a finite number of elements of S is of the form «(1, 0, 0) 
++ 6(0, 1, 0) = («, 6, 0). The set of all such linear combinations is [5S]. 
Actually, [S] ={{(«, B, 0) | «, 8 any scalars}. In this case [S] can be written 
also as [(1, 0, 0), (0, 1, 0)}. We can see that it 1s a subspace of V,. In fact, 
this is true in all cases. We shall state and prove this assertion in the 
form of a theorem. 

3.3.3 Theorem Let S be anonempty subset of a vector space V. Then [S}, 
the span of S, is a subspace of V. 
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Proof: By Theorem 3.2.2, we Mave only to prove that [ST] is closed 
for addition and scalar multiplication. Let # and v be any two vectors in 
{S]. Then 

U = OU, + Agu, + ... + Mu, for some scalars a,, some 
u,’s G S, and a positive integer 7, 
and vy m= B,v, + Bavg +... + BaYe for some scalars B,, some 
vectors ¥,’s € S, and a positive integer m. 
Hence, u -+- v= ayy +... + Oly + Bi, + ... + Bum. This is again 
a finite linear combination of S and so u + v € [S]. Similarly, 
au = (a%,)u, + ... + (aa,)Uu, is again a finite linear combination of 
S and so itis in [S]. Hence, [S] is a subspace of V. §j 
3.3.4 Remark A nontrivial subspace always contains an infinite number 
of elements. So [S] (4V,) always contains an infinite number of ele- 
ments. But S itself may be a smaller set, even a finite set. By con- 
vention, we take [b] = V4. 
3.3.5 Theorem Jf S is a nonempty subset of a vector space V, then [S] is 

the smallest subspace of V containing S. 

Proof : Clearly, [S] is a subspace by Theorem 3.3.3. It contains S, 
because each element u, of S can be written as lu), i.e. a finite linear 
combination of S. To prove that [S] is the smallest subspace containing 
S, we shall show that if there exists another subspace 7 containing S, then 
T contains [S] also. 

So let a subspace 7 contain S. We have to prove that T contains [S]. 
Take any element of [S]. It is of the form ou, + au, +... + %,U,, where 
a,’S are scalars, t,, ug, ..., 4u, are in S, and 7 is a positive integer. Since 
SC T, each u, also belongs to T. Since T is a subspace, au, -- agt, + ... 
+ «,Un should also belong to 7. This means that each element of [S] is 
in T. § 

Example 3.12 In V, show that (3, 7) belongs to [(1, 2), (0, 1)], but does 
not belong to [(1, 2), (2, 4)]. 

Clearly, (3, 7) belongs to [(1, 2), (0, 1)], if 1t is a linear combination of 

(1, 2) and (Q, 1), Le. if 
(3,7) = a(1, 2) + B(0; 1) = (@, 2a, +B) 
for some suitable a and 8. This is possible only if 
a=3, te+f6 = 7. (1) 
Solving Equation (1), we geta = 3, B = 1. Thus, (3,7) = 3(1, 2) + 
1(0, 1). Hence, (3, 7) € [(1, 2), (0, 1)]. ; 
Further, it (3, 7) € [(1, 2), (2, 4)], then 
(3, 7) = a(1, 2) + B(2, 4) = (a + 28, 20 + 46) . 

for some suitable « and 8. This gives 

a+ 268 = 3, 20+ 46 = 7. (2) 
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But these equations cannot hold*at the same time. So (3,7) & [(1, 2), 
(2, 4)]. 
Example 3.13 In the complex vector space VS show that (1 + é, 1 — i) 
belongs to [(1 -+ 7, 1), (1, 1 — Z)]. 
(i + 4 1),0,1 — ad] = {a1 + ¢,1) + BUI, 1 — 2) | @, B complex scalars} 
= {(2 + 6+ ai, a + 8 — Bi) | a, B complex scalars}. 
(1 +- i, 1 — i) belongs to [(1 + 7, 1), (1, 1 — JO] if 
I+ijl—) = «+6 + ai,a-+ 6 — Bip 
for some scalars «, 8. Thus, 
l+fieay P+ai = a1 +i) +8 
l1—-i=a+8—fi=a+A(l—d). 
Solving for a, 8, we geta = 1+ i,8 = 1 — i, showing that (1 + i, 
1 — i) belongs to [(1 + 7, 1), (1, 1 — Jd). 


Problem Set 3.3 


lL Let S = {(1, 2, 1), (J, 1, —1), (4, 5, —2)}. Determine which of the 
following vectors are in [S]: 
(a) (0, 0, 0) (b) (1, 1, 0) (c) (2, —1, —8) 
2. Let S = {x5, x* + 2x, x*7 + 2,1 — x}. Determine which of the follow- 
ing polynomials are in [5] : 


(a) 2x® + 3x? + 3a 4 7 (b) x4 + 7x4 2 
(c) 3x°+x+ 5 (d) ese 4 
(ec) 3x +2 (f) x3 + x? + 2x + 3. 


3. If Sis a nonempty subset of a vector space V, prove that 
(a) [S] = Sif Sis a subspace of V 
(b) [[S]}] = [S]. 
4. Let v1, Vg, ...) Yn be 7 elements of a vector space V. Then prove that 
(a) [v:, Vas aces Vn] os [o.%, AgVas wens GaVnl, a, #0 
(b) [¥,, vp] = [¥) — Yo % + Ve] 
(c) Ifv, € [v,, vg, ..-) Me-y], then 
[Vis Ver ven> Viergs Ve» Vitts sar Val = [Pye Vas oes Vents Versys soe» Made 
5. Let S be a nonempty subset of a vector space V andu, v € V. If 
ué& [S U {v}] but « & [S], then prove that vy € [S U {u}]. 
6. What is the span of 
(a) x-axis and y-axis in V, ? 
(b) x-axis and xy-plane in V, ? 
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(c) xy-plane and yz-plane in V, ? 
(d) x-axis and the plane x + y = Oin V,? 
7. True or false? 
(a) Span of x + y = Oandx — y = Oin JV, is V,. 
(b) V, has a subspace consisting of 7 elements. 
(c) The span of the set {x, x, x8, x4... }1s 9. 
(d) In V,, [y-axis U z-axis] = Vj. 
(ce) In V;, [A] = fi, k,i +A] O [S&F + Ay. 
(f) In VE, (—1, 2, 0) € [G, —i, 1), (0, —i, —1)]. 
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Let U and W be two subspaces of a vector space V. Their intersection 
U (\ W cannot be empty, because each contains the zero vector of V. 

Now, if « and v are two vectors of U () W, thenu+ ve Uand 
u+v€ W, because U and W are subspaces of V and u, v both belong to 
U as wellas W. Hense,u-+v CG U) W. Similarly, if « is any scalar, 
then au isin both Uand W. Hence, au € U(\ W. This shows that if 
U and W are subspaces of V, then U (\ Wis also a subspace of V. 

This result can be generalised to any number of subspaces. More 
precisely, if U,, U,, ..., U, are n subspaces of V, then their intersection 
U,1\ U2 ... 1 U, is also a subspace of V (see Problem 1). We shall 
use this fact in an interesting way in the following example. 

Example 3.14 Let W be the set of all vectors (x,, x2, ..., X,) of V>, satisfy- 
ing the three equations 


OX, + WX_ +... + HX, = 0 (1) 
Pix) + Bax +... + Bat, = 0 (2) 
Y1X%1 + YgX%e + ee + YnX%n = 0. (3) 


Then W = W, 1) W, 1 Ws, where W, 1s the solution set of Equation 
(1), W, is the solution set of Equation (2), and W, is the solution set of 
Equation (3). Each W, is a subspace by Example 3.11. So, by the foregoing 
argument, W is a subspace of V,,. 

Thus, we have proved that the intersection of two subspaces is always a 
subspace. On the other hand, the union of two subspaces need not be a 
subspace. For example, take U = x-axis and W = y-axisin V,. U and 
W are subspaces of V,. Here (1,0) € U and (0, 1) € W. So both (j, 0) 
and (0, 1) belong to UU W. But (1,0) + (0,1) = (1,1) UUW. 
This shows that U \j W is not a subspace of V,. 

Thus, U ) Wis not in general a subspace. However, we know, by 
Theorem 3.3.5, that [UU W] is the smallest subspace of V containing 
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UU W. Let us now analyse the subspace [UU W]. Any element of 
chis subspace is a linear combination of a finite subset of U U W. In other 
words, a vector vy of [U _) 7] is of the form 

y = al, +... + Ely + Bw, +... + BoWn, (4) 

where u,’s € U, w,’s © W,n and m are nonnegative integers, and «’s, B’s 

are scalars. But «,u, -+ ... + %M, 1s a vector in Vand B,w, +... + BaWm 

is a vector in W. Therefore, + can be expressed as u + w, whereun © U 

and w ec W. Sowecan say that [(U U W] concists of elements of the form 

ut+w,uc U,andwe W. 

3.4.1 Definition (Addition of sets) Let A and B be two subsets of a vector 
space V, Then the sum of A and B, written as A + B, is the set of 
all vectors of the form u + v,u € A, andv € B, that is, 

A+ B= {u+v[_uce 4,v ce B. 

Example 3.15 In V, let 4 = {(1, 2), (0,1)} and B = {(1, 1),(—l1, 2), 

(2, 5)}. Then 
A+ B= {(1, 2) + (1, 1), (1, 2) + (—1, 2), (1, 2) + (2, 5), (0, 1) 

+ (1, 1), (0,1) + (1, 2), , 1) + (2, 53} 
== {(2, 3), (0, 4), (3, 7), (1, 2), (—1) 3), (2, 6)}. 

Example 3.16 In V,let A = {(2,3)}, B = {¢(3, 1) | tascalar;. Then 
A+Be= {(2, 3) + (3, 1) | ¢a scalar} 

{(2 + 3t, 3 + t) | 2 a scalar}. 

Geometrically, B is a line through the origin and A is a set containing 
one vector (Figure 3.i). A + Bis a line parallel to B and passing through 


the point (2, 3). 


ll 


FiGure 3.1 


Example 3.17 In V, let A = {a(1, 2,0) [aa scalar}, B = {8(0, 1, 2)| 8 
a scalar}. Then 
A+ B = {a(1, 2,0) + 6(0, 1, 2) | «, 8 scalars} 
=x {(a, 2a, -++-8, 28) | «, 6 scalars} . 
Geometrically, A and B are lines through the origin in V, and A + B 
is a plane containing these lines and passing through the origin (Figure’3.2). 
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In this case A+B = (a, 2, 0), (0, 1, 2)). 


Figure 3.2 


34.2 Theorem Jf U and W are two subspaces of a vector space V, then 
U + Wis asubspace of VandU+ We [UU W]. 
Proof: Obviously, U + WC[U U W], because each vector of U -+ W 
is a finite linear combination of U U W. We shall now prove that [U U W] 
CU+W. Lettre [U U W]. Then the argument preceding Defint- 
tion 3.4.1] shows that vis of the form u + w, forsomeu € Uandw € W. 
Hence,v eG U+ W. Thus, 0+ W= [U U W]. This amomatically 
makes U + Wa subspace of V. § 
3.4.3 Remark From Theorem 3.4.2 it follows that U + Wis the smallest 
subspace of V containing U U W,1.e. both U and W. 


Example 3.18 If V = V;, U = x-axis, and W = y-axis, then U + W is 
the set of all those vectors of V, that are of the form (1, 0, 0) + (0, 1, 0). 
Therefore, U-+ W = {(a, B, 0) |, B are scalars}. On the other hand, 
{U U W] consists of vectors of the form au + Bw, where «, 6 are scalars, 
uc U,we W. This gives , 
[UU W] = {a(1, 0, 0) + (0, 1, 0) | 2, B are scalars} , 
which is the same as U + W. This illustrates Theorem 3.4.2. Note the 
interesting relation arising from this example - 
[x-axis U y-axis) = x-axis + y-axis = xy-plane. (5) 
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DIRECT SUM 


We have just seen that if U and W are subspaces of a vector space JV, 
then the sum U-+ W is also a subspace of V. If, in addition, Us. W 
= V, = {0}, the sum U + Wis called a direct sum. The direct sum of 
U and W is written as U @ W. 

Example 3.19 We can check the following additions in V, : 

xy-plane + yz-plane = V, (6) 
xy-plane + z-axis = F,. (7) 
The sum in Equation (7) is a direct sum, because (xy-plane) () z-axis 
= {0}. So Equation (7) can be rewritten as 
(xy-plane) @ (z-axis) = V, . (8) 
The sum in Equation (6) is not a direct sum, because 
(xy-plane) (1 (yz-plane) = (y-axis) 4 {0}. 
Any vector (a, b, c) € V, can be written as 
(a, 5,c) = (a, 5, 0) + (0,0, ¢), (9) 
where (a, b,c) € xy-plane, (0, 0, c) € Z-axis. Thus, (a, 5, c) is the 
sum of two vectors, one in the xy-plane and the other in the z-axis. The 
advantage of the direct sum lies in the fact that the representation (9) is 
unique. That is, we cannot find two other vectors, one in the xy-plane and 
the other in z-axis, whose sum is (a, b, c). The reader can check this for 
himself. 

On the other hand, in Equation (6) any vector (a, b, c) can be 
written as the sum of two vectors, one in the xy-plane and the other in 
the yz-plane, in more than one way, for example, 

(a, b, c) = (a, b, 0) + (0, 0, ¢) (10) 
and 
(a, b, c) = (a, 0, 0) + (0, b,c). (11) 

The fact asserted in this example is generalised in the following 
theorem. 

3.4.4 Theorem Let U and W be two subspaces of a vector space V and 
Z=U+ W. Then Z = UQW iff the following condition is 
satisfied : 

Any vector z © Z can be expressed uniquely as the sum 
z=u+w,ue U,we W. (12) 
Proof: Let Z U@® W. Since Z = U + W, any vectorz € Z 
can be written as 
z=u+tw, (13) 

forsomeu € Uandwe W. 

Suppose it is possible to have another representation 


z=u+y', (14) 
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for some u’ € U and w’ € W. Then 
utw=y' +w’ (14) 
or 

u—y’=w'—w. (15) 


But u— wu’ € U and w’—we€E W. From Equation (15), we find that 
u—u=w'—we UN) W = {0}, since Z is a direct sum of U and W. 
Hence, u — u' = 0 = w’ — w, which implies that u =u’ and w=w’. So 
no such second representation for Equation (13) is possible. In other 
words, condition (12) is satisfied. 


Conversely, let condition (12) hold. We shall now prove that Z is 
a direct sum of U and W. Since Z = U + W, we have only to prove that 
Ul) W = {0}. 


Let, if possible, U 1) W contain a nonzero vector y. Theny € U, vE 
W,andv=v-+0€U+W with vEU and OE W. Also v=0+VE 
U + W with 0 € Uand v € W. These two ways of expressing a vector v in 


U + W contradict the hypothesis (12). Hence, U 1 W = {0} and Z = 
U@wWw. | : 


3.4.5 Definition If U is a subspace of a vector space V and vy a vector of 
V, then {v} + U, also written asv + U, is called a translate of U 
(by v) or a parallel of U (through v) or a linear variety. 


U is called the base space of the linear variety and v a leader. Note 
that {v} 4- U is not a subspace unless v E U. (Why 2?) 


As illustration, take the line y = x through the origin in V,. Call it U. 
Consider the point v = (1, 0). The translate v + U of U by v is the line 
y = x — 1 through the point (1, 0) (Figure 3.3). It can also be obtained 
by adding (1, 0) to the vectors in y = x. 


ve(1,0) xX 
(b) 


FIGURE 3.3 


As a second illustration, take the plane y = 0 in V, and call it U. Con- 
sider the point v = (1, 1,1) € Vy. (1, 1, 1) + U is the set of all points of 
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V, given by (1, 1,1) +a, where u€@ U. Geometrically, it is the plane 
parallel to y = 0 through the point (1, 1, 1) (Figure 3.4). 


FIGURE 3.4 


The following theorem gives the fundamental properties of a linear 
variety. 


3.4.6 Theorem Let U bea subspace of a vector space V and P=v+U 
be the parallel of U through y. Then 
(a) for any win P,w + U = P. In other words, any. vectur of P can 
be taken as a leader of P; 
(b) two vectors ¥,, ¥. & V are in the same parallel of U iffy, — ¥, € U. 


Proof : (a) Let w be a vector of P. Since P = v + U, wcan be express- 
ed as v + u, for someu, € U. Sow = v + uy, or, equivalently, v = w — u,. 
Let z € P. Then z has the expression z == v + u, for a suitable u, € U. 
Since v= w— u,, we have z = (w — u,) + ug = w+ (uy — u,). Here 
u,—u,E U. Thus, every vector z of P has the form w + (some vector 
in U). SoPCw+JU. Conversely, lety€ w+ U. Then y is of the 
form y= w+u for a suitable u€ U. The vector y= wt+u=v+ 
(u, + u) is of the form v + (a vectorof U). Soy€v+U=P. This 
shuws thatw + UCP. Hence,w+ U =P. 


(b) Let »,, v, be in the same parallel of U, namely, v+ U. So 
v, =v -+ 4, for some u, € U, and v, = v + uy for some u,E U. Then 
¥, — Vg =(v + a) — (V+ 4.) = & — Uy, Which belongs to U. Con- 
versely, if v4; —v.G U, then v, —¥% =u for some wEU. So 
vy, = v¥g-+u. Therefore, v,€ v,+U. Also v»,=v, +0. Therefore, 
vy, © », + U, sinceO € U. So v, and v, belong to the same parallel 
v, + U. § 


As illustration, take V = V, and U = yz-plane. Let v = (1, 1, 1). 
Then P = v + U is the parallel given by the set 


{(1, 1, 1) + (©, B, y) 18, + arbitrary scalars} 
== {(1, 1 + 8, 1 + 7) | 6, ¥ arbitrary scalars}. 
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Part (a) of Theorem 3.4.6 says that to describe this set we could take 
instead of (1, 1, 1), any other vector from P. Let us take vector (1, 0, 0), 
which is also in P. The theorem says that every vector 

(1,1, 1) + @, 8, y) 
can also be written in the form 

(1, 0, 0) + (0, 8’, +’) 
for suitable 8’ and y’. Clearly, 8’ = 1 + Band y’ — 14 ¥. 


To continue the illustration, both (1, 1, 1) and (1, 0, 0) are in P. The 
difference (0, 1, 1) is obviously in U. Part (b) of the theorem says that 
whenever the difference of two vectors belongs to U, then they both belong 
to the same parallel and conversely. 

3.4.7 Remark Starting from a subspace U, we can obtain many parallels 
of U. This is the same as starting from one straight line through 
the origin and drawing many parallel straight lines through different 
points in the planc. Given a vector v € V, we get a parallel v + U. 
If we take another vector v’ € V, the parallel v’ + U obtained from 
v’ will be different from v + U iffy’ 1s not in V + U. 


Problem Set 3.4 
1. Let Uj, Ug,...; Ug be m subspaces of a vector space V. Then prove 
n 
thatU, NU, ... AN Un = NO VU, is also a subspace of V. 
i=} 


2. If U and W are subspaces of a vector space V, prove that 
(a) U1) W isa subspace of W 
(b) U U W isa subspace of Viff7U CWorW C U. 
3. If S isa nonempty subset of V, prove that [S] is the intersection of all 
subspaces of V containing S. 
4. Prove that the set of vectors (x,, 3, .... Xn) € Vq satisfying the follow- 
ing m conditions is a a. of V,,: 
OyyXy fb OygX_ it... + Ainkn = O : 
a + an +. + — sa 0 


Cas % 5 dims \s ea tmaXn = 0, 
a,,'s are fixed scalars. 


5. Find the intersection of the given sets U and W and determine 


whether it is a subspace. 
(a) U = {(%1, Xs) € Vs | x ? 0}, W = {(*, Xs) € v*{ xy < 0} 
(b) U ={fE SY (—2, 2) |A—N = 9}, 


W={fe ¢(—2, 2) | Al) = 0} 
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(c) U={fe ¥(-2,4) | lim f(x) = 0}, 
={fe ¥(-2, 2) | lim K(x) = 1} 
(4) U=9?,W={fE ¥(-~@, ») | f(x) =/(—x)}. 


6. Describe A + B for the given subsets A and B of Vs and determine in 


10. 


11. 


each case whether it is a subspace or a parallel or just a subset of V,. 
(a) A= {(1, 2), (0, 1)}, B= i(l, 0), (3, —1)} 


(b) A = {(1, —2), (5, 1}, B = {(3, 5), (4, 3), (V2; ™)} 
(c) A= {(t, }}, B = segment joining (1, 1) and (2, 3) 


(d) A= {(2, 3)}, B= {t(3, 4) |1<t < 2} 

(e) A= {(3, 7)}, B = {(t(—1, 2aioct< tl 

(f) A= {(d, 2)}, B= {t@, 0) | t > 0} 

(g) A = {(2, 4)}, B = {(, y) | 2x + 3y = 1} 

(h) A= {(1, 5)}, B= (x,y) [e+ y? =1} 

(i) A= {(3,4)|0O<¢ < 1}, B= {1(22, 5) |1 <t < 2} 
ij) A= {11,0 [01 1}, B= (10, |2<t < 4} 
(k) A = {(1, 0) | t#ascalar}, B = [(1, 2)] 

(l) A = line x = 3t, y = 4t, B = line 2x -+ Sy = 0. 


Describe A + B for the given subsets A and B of V;. Determine in 
each case whether A + B is a subspace or a parallel or just a subset of 
V3. 


(a) A= {(I, 2, 1}, B= {t(1, 2, 0) | ¢ a scalar} 

(b) A= {(3, 1, —1)}, B= {(x yz) | x+y + z = 0} 
(c) A = {(1, —3, 4)}, B= [(1, 2, 3), (0, 0, 1)] 

(d) A = [(1, 2, 3)), B = ((3, 1, 0)] 

(ec) A = [{(1/2, 2/3, 1)), B = plane 2x + 3y + z= 0 
(f) A= [(5, 0, 2)], B = [(1, 2, 3), ©, 1, 2)] 


(g) A= ((1, 0, —1)], B = [(2, 5, 8), (2, 3, 4)]. 
If U and W are two subspaces of a vector space V, prove that 
U+W=Uigwceu. 
Let A and B be two nonempty finite subsets of a vector space V. Then 
prove that 
(a) [4M B]C [4] N [B) 
(b) [A U B) = [A] + [8]. 
if U,, U,, and U, are three subspaces of a vector space V, prove that 
(Uy N U;,) + (U, N Us) C (CU, + Uy) N U;y. 
(a) Prove that two parallel straight lines in V, are parallels of the 
same nontrivial subspace of V3. 
(b) Prove that the sum of two distinct intersecting lines in V, is Vs, 
{s it a direct sum ? 
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12. (a) Show that the set of all solutions of the equation 3x, ++ 2x3—X; 


13. 


14. 


15. 


16. 


+ x, = 5 can be expressed as (1, —2, 2, 8) + W,Ewhere! W is 
the space of all solutions of the equation 3x, + 2x, — x, + 
Xs — 0. 


-(b) Let W be the set of all solutions of the equation «,x, + x, + 


w+. Tt &_X, = 8. Then show that W is a parallel in V,. Find 
its base space and a leader. 
Show ,that the given set P is a parallel in (¢ 0,2). In each case 
find the base space and a leader. 
(a) P= {f| f(x) = 3x°} 
(b) P= {f|f'(x) = xe*} 
(c) P= {f| f(x) = sin x} 
(d) P= {f|f"(x) = x? + 2x + 3} 
(e) P=={f| fl) == 2}. 
LetU = {f€ ¥’(—a, a) | fis odd}, and 
W={fE ¥ (—a, a) | fis even}. 
Then describe (a) U (1\ W and (b) U + W, and determine whether they 
are subspaces of “’(—a, a). Is¢¥7(-a,a) CU+W?IsU+ W 
a direct sum? Is C (7% a)= U@W? 
Prove that a linear variety is a subspace iff its leader belongs to the 


base space. 
True or false ? 
(a) For any subset A of a vector space V, : 
[A] == [A + Al]. 
(b) If U,,i = 1,2,... are subspaces of V, then U, is a subspace 
of V. - 7 


(c) The intersection of two linear varieties is a linear variety, pro- 
vided it is nonempty.- 

(d) The sum of two linear varieties may not be a linear variety. 

(ec) The union of two linear varieties need not be a linear variety. 


(f) The set of all solutions of the equation Hs = g, where g 
is a constant, is a linear variety in (0, ©). 


(g) In Example 3.14 V, cannot be replaced by V<: 


3.5 LINEAR DEPENDENCE, INDEPENDENCE 


We start this article with the definition of ‘trivial’ and ‘nontrivial’ 


linear combinations. 
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3.51 Definition If u,, %, ..., U, are m vectors of a vector space V, then 
the linear combination 
Oty f+ Allg + ... + Only (1) 
is called a (¢rivial linear combination if all the scalars «,, a, ..., &n 
are zero. Otherwise the linear combination is said to be nontrivial. 
In other words, a nontrivial linear combination is of the form (1), 
where at least one of the «’s is not zero. As illustration, 
Ou, + Ou, + ... + Om, is a trivial linear combination; 
Ou, + Cu, +... + Ou,-, + Iu, is a nontrivial linear combination; 
and 
lu, + 2u, + 3u; + ... + nu, is also a nontrivial linea: combination. 
Note that the trivial linear combination of any set of vectors is always 
the zero vector, for 
Ou, + Ou, ++ ... + 0u, =O0+04+..4+0=0. 
The question arises whether a nontrivial linear combination of a set of 
vectors can give the zero vector. The answer is in the affirmative. Consi- 
der the following examples. 


Example 3.20 Let (1, 0, 0), (2, 0, 0), and (0, 0, 1) be three vectors in V3. 
Then we have 

1q1, 0, 0) + (— }) Q, 0, 0) + 0(0, 0, 1) = (0, 0, 0) = O. 
Thus, a nontrivial linear combination may give the zero vector. 
Example 3.21 Let (1, 0, 0), (0, 1, 0), and (0, 0, 1) be three vectors of V3. 
Take any linear combination of these vectors, say 

a(1, 0, 0) + 20, 1, 0) + (0, 0,1), 

which is the same as (a, 6, y). If this were to be the zero vector, then 
(x, 8, y) = (0, 0, 0). Therefore, « == 0 = B = y. 

In this case the only linear combination that gives the zero vector is 
the trivial linear combination. The same is true in the following example. 
Example 3.22 Let (1, 1, 1), (1, 1, 0), and (1, 0, 1) be three vectors. As 
before, if 

a(1, 1,1) + BC, 1,0) + y(1, 0, 1) = (0, 0, 0), 
then (2+B+ y7,¢+ 8,4 + y) = (0,0, 90). 
Therefore, « +8 +y7y=0,4+8=0,anda+ += 0. These give « = 
O=6=y. 

It is clear that these three examples fall into two categories. Examples 
3.21 and 3.22 are of one kind, whereas Example 3.20 is of another. In 
Example 3.20, (1, 0, 0) is a linear combination of (2, 0, 0) and (0, 0, 1) : 

(i, 0, 0) = $(2, 0, 0) + 0(0, 0, 1) ‘ 
In other words, (1, 0, Q) depends on (2, 0, 0) and (0, 0, 1). We say that 
these three vectors are linearly dependent. On the other hand, in Examples 
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3.21 and 3.22 there is no such dependence of one vector on the others. We 

say that they are linearly independent. __- 

We formalise these concepts of linear dependence and linear indepen- 
dence in the following definitions. 

3.5.2 Definition A set {u,, tg, ..., Mn} Of vectors is said to be linearly 
dependent (Lp) if there exists a nontrivial linear combination of 
Uy, Us, ..., Uy that equals the zero vector. 

Example 3.23 Prove that the vectors (1, 0, 1), (1, 1, 0), and (—1, 0, --1) 

are LD. 

To prove linear dependence we must try to find scalars «, 8, y such that 
a(1, 0, 1) + B(1, 1,0) + y(--1, 0, —1) = 0 = (0, 0, 0). 
Therefore, « + 8 — y = 0,8 = 0, anda — y =0. This can happen iff 

a == y. Any nonzero value for «, say 1, will do. Thus 

1(1, 0, 1) + O(1, 1, 0) + 1(—1, 0, —1) = 0. 

So there exists a nontrivial linear combination of the given vectors, which 

equals the zero vector. Hence, the vectors are LD. 

Once we find a nontrivial linear combination equal to the zero vector, 
linear dependence is proved. Very often it is possible to guess such a 
linear combination. 

3.5.3 Definition A set {u,, u,, ---, up} of vectors is said to be linearly 
independent (11) if no nontrivial linear combination of 4, t,, ..., Un 
equals the zero vector. 

‘No nontrivial linear combination equals the zero vector’ means the 
following : 

If at all there is a linear combination that equals the zero vector, then 
it must be the trivial linear combination. Now recall that the trivial 
linear combination is always zero. So the statement within quotation 
marks means ‘The only linear combination that equals the zero vector is 
the trivial linear combination’. In view of this, Definition 3.5.3 can 
be reworded as follows. 

3.5.4 Definition (Reworded) A set {u;, tg, .... Un} Of vectors is said to 
be linearly independent (1) if the only linear combination of 
Ui, Us, .... Un that equals the zero vector is the trivial linear 
combination. 

By convention, the empty set is considered to be Lt. Note that linear 
dependence and linear independence are opposite concepts. 
Example 3.24 Prove that the vectors (1, 0, 1), (1, 1, 0), and (1, 1, —1) 
are LI. ; 

If possible, let 

(1, 0, 1) + B(1, 1, 0) + (1, 1, —1) = 0 = (0, 0, 0). (2) 

This gives «2 +8 + y= 0,6 +-y=0, anda —y=0. Therefore, « = 0 
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='B=y. This means that the only values of a, B, y that ‘satisfy 
Equation (2) are « = 0 = B = ¥, i.e. only the trivial linear combination 


equals the zero vector. Hence, the given vectors are LI. 


HOW TO CHECK LINEAR DEPENDENCE OR INDEPENDENCE 


The foregoing discussion tells us that when we are given a set 
{t,, tg, ...) Un} Of vectors and we want to check whether it is LD or LI, 
the following procedure will be the natural one. 

First, we assume that some linear combination of 4, %, ..., Un is equal 
to the zero vector, that is, : 

Oty + Oty +... + Onn = 0. (3) 
Then two cases arise. One is when it is possible to find scalars «,, 2, ... & 
with at least one of them not zero such that Equation (3) is satisfied. In 
‘this case we conclude that the vectors u,, Ue, ..., Un, are LD. 

The other case is when we can prove that our assumption automatically 
implies that a, = 0 = a, =... = a,. In other words, the only values of «,’s 
that satisfy Equation (3) are «, = 0 for each i? = 1, 2, ..., m. In this case 
we conclude that u,, u,, ..., MU, are LI. 

In the first case, even guesswork in finding the suitable scalars is 
enough, whereas in the second case a proof is necessary. 


Example 3.25 Check whether the following set of vectors is LD or LI: 
{(, 0, 1), (1, l, 0), (1, =I, 1), (i, 2, —3)} . 


Suppose 

a(1, 0, 1) + BCI, 1,0) + y(t, —1, 1) + 8(1, 2, —3) = 0 = (0, 0, 0) 
or (x+B+y+5, B— y + 25, « + y — 35) = (0,0, 0) 
or etPB+y+5=0,8 —7Y+268=00+y7-— 38=0. 
This system has a solution « = 55, 8 = —48, y = —26 for each choice 


of 8. Take & = 1. This gives 
S(1, 0, 1) — 4(1, 1, 0) — 2(1, —1, 1) + 1(1, 2, —3) = (0, 0, 0). 
Hence, the.given set is LD. 
Example 3.26 Check the linear dependence or linear independence of the 
set {e, e**} in F7(?)(—00, 00), 
Suppose that 
ae? + Be = 0 (x) = 0 for all x E (00, 00) , 
This gives, on differentiation, 
ae* + 2Be* = 0 for all x € (—©, ©). 
Solving these two equations for « and 8, we get 
Be** = O for all x € (—00, 0); 
but e** is never zero and hence ® = 0. It then automatically follows that 
« is also zero. Thus, the only linear combination that equals the zero 
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vector is the trivial one. Hence, the given set is Li in G7‘~)(—00, oo), 
We also say that the set 1s LI over (—©, ©), 


Example 3.27 Check the linear dependence or linear independence of the 
set {x, |x| }in F& (1, I). 


Suppose ax + B |x| = 0. 
Since the function |x| is not differentiable at zero, we cannot use 
the method in Example 3.26. 
ax + B|x| = 0 holds for all x in (—1, 1). So choosing two diffe- 
rent values of x, say x = 1/2 and x = —1/2, we get 
2 dee a 
> + >= 0 and >z +4. 7 = 
Solving these two equations, we get x = 0 = 8. Hence, the set is 11 
over (--1, 1). 
We shall now take up the geometrical meaning of linear dependence. 
For this we need the following definitions in a vector space V. 
3.5.5 Definition Given‘a vector v # 0, the set of all scalar multiples of 
v is called the line through vy. 
Geometrically, in the cases of V,, V,, and V, it is nothing but the 
Straight line through the origin and v. 
3.5.6 Definition Two vectors v, and v, are collinear if one of them lies in 
the ‘line’ through the other. 
Clearly, 0 is collinear with any nonzero vector v. 
3.5.7 Definition Given two vectors v, and v2, which are not collinear, 
their span, namely, [¥,, vg], is called the plane through v, and vo. 
Geometrically, in the cases of V, and V, it is nothing but the plane 
passing through the origin, v, and v,. 
3.5.8 Definition Three vectors ¥,, ¥., and v, are coplanar if one of them 
lies in the ‘plane’ through the other two. 
Clearly, 0 is coplanar with every pair of noncollinear vectors. 
Example 3.28 The vectors y and 2v of a vector space V are collinear, 
because 2yv lies in the ‘line’ through y, i.e. 2v isa scalar multiple of v. In 
particular, sin x and 2 sin x are collinear in $(J). 
Example 3 29 The functions sin x and cos x in F(Z) are not collinear, 
because neither of the two lies in the ‘line’ through the other, i.e. one is 
not a scalar multiple of the other. Their span, namely, 
[sin x, cos x] = {a sin x + B cos x | «, B any scalars} 
is the plane through the vectors sin x and cos x. 
Example 3.30 The functions sin x, cos x, tan x in F¥(/) are obviously not 
coplanar, because none of them lies in the ‘plane’ through the other two. 
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Example 3.31 The functions sin*x, cos?x, cos 2, are coplanar. cos 2x lies 
in the plane through sin?x and cos’x, since cos 2x is a linear combination 
of cos*x and sin*x. 
3.5.9 Theorem Let V be any vector space. Then 
(a) The set {v} is Lo if v = 0. 
(b) The set {v,, ¥,} is LD iff v, and v, are collinear, t.e. one of them is a 
scalar multiple of the other. 
(c) The set {v,, Ve, ¥5} is CD iff v,, ¥., and v, are coplanar, i.e. one of 
them is a linear combination of the other two. 


Proof: (a) {v} is LD iff there exists a nonzero scalar « such that 
ay =. This is possible (Problem 5, Problem Set 3.1) if v = 0. 

(b) Suppose {v,, v2} is LD. Then there exist scalars «, 8 with at least 
one of them, say « + 0, such that ar, + Av, = @. Therefore, v, 
== (—§/a) vz, which means y¥, is a scalar multiple of vs, i.e. v, lies in the line 
through v.. Hence, v;, v, are collinear. 

Conversely, if v, and vy, are collinear, then, by definition, one of them, 
say v,, lies in the line through v,. Therefore, v, is a scalar multiple of y,. 
So vi = ave, i.e. 1+ ¥, — ave = 0. Hence, v, and v, are LD. 

(c) Suppose {¥,, ¥,, ¥3} is LD. Then there exist scalars «, 8, and y 
with at least one of them, say « ~ 0, such that 
av; + Bre + vg = 0 
or ¥, = (—B/a) vg + (—y/a) vy . 
This means v, € [v., vs]. Hence, v, lies in the plane thiough v, and v,. So 
V1, Ya, and vy, are coplanar. 

Conversely, if ¥,, v2, and vs are coplanar, then one of them, say 
v, & [v2, val, i.€. ¥, = %_¥q + %4V, for suitable scalars a, and «,. Therefore, 
lv, — %Vo — %¥s = 0. Hence, ,, vg, and v, are LD. 

As illustration, consider the three vectors (i, 1, 1), (1, —1, 1), and 
(3, ~1, 3). They are LD, for 

(1, 1,1) + 201, —1, ) — 13, —1,3)=0. 
Hence, by Theorem 3.5.9, the plane through (1, 1, 1) and (3, —1, 3) con- 
tains the point (1, —1, 1). Let us verify this. 

The plane through (1, 1, 1) and (3, —1, 3) is 

{(1, 1, 1), (3, —1, 3)] = {(« + 38, « — 8, + 38) | «, B any scalars}. 
This set contains (1, —1, 1), for we have only to choose « and § such that 
a+3B=le—6§6 = —l,a+ 38 = 1. 
This gives « = —1/2 and 6 = 1/2. 

Before we proceed, we shall record some simple facts about linear 
dependence. 

3.5.10 Fact Ina vector space V any set of vectors containing the zero 
vector is LD. 
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For, if {v,, Va, ...9 vn} is a set and vy, = 0, 
then 
Ov, “+ Ov, + ..+ Ov,.) + ly + OVie, + ... + Ov, 
is a nontrivial linear combination resulting in the zero vector. 


3.5.11 Fact In a vector space V, if v is a linear combination of 
Vis Vay ssp Vny 1.€. v E [v, Vg, ..., Yn), then {v, ¥,, ..., ",} iS LD. 
For, v € [¥,, v2. ...) Ya} Means 
V = OV, + avs + ~ + Gn, 
ie. ly — av, — ... — &yv, = 0. 


3.5.12 Fact In a vector space V, if the set {v,, vg, .... Va} iS LI and 
v & [v,, Vs, ..-, Yn], then the set {v, v1, Vs, ..., Vn} IS LI. 
The proof is left to the reader. 


In the case where the set consists of just two or three vectors, we can 
look at these facts from the ‘geometric’ point of view of Theorem 3.5.9. 
For the purpose of understanding, imagine that V = V, (though this is not 
necessary for the argument). Since 0 lies in the line through y, {0, v} is 
always LD by Theorem 3.5.9 (b). Similarly, 0 always lies in the plane 
through any two vectors v,, ¥2. Hence, {0, v,, v.} is always LD by Theorein 
3.5.9 (c). 

The idea contained in Theorem 3.5.9 does not stop with just three 
vectors. We can in fact work out a general result on the same lines for 
a linearly dependent set of 2 vectors. Before we do that, let us look at the 
theorem once again. Actually, in the proof, we have indicated the 
following : 


(1) {v,, vg} is LD iff one of the vectors is a scalar multiple of the 
other and (i1) {¥,, v2, ¥3} is LD if one of them is a linear combination of 
the others. 

In general, we shall now prove in Theorem 3.5.14 that if {v,, va, .... Va} 
is LD, then one of the vectors is a linear combination of the others, the 
converse of which is Fact 3.5.11. Before that, we state the following 
simple theorem and leave its proof to the reader. 


3.5.13 Theorem (a) If a set is Li, then any subset of it is also Li, and 
(b) [fa set is LD, then any superset of it is also LD. 


3.5.14 Theorem Jn a vector space V suppose {V;, V2, ...» Vn} is an ordered set 
of vectors with v, + 0. The set is LD iff one of the vectors 
Veg, Vgp «++» Yn» SAY Vg, Delongs to the span of V,, ...5 Venn, 7. Ve E [Vs 
Ve, .. » Vea) for some k = 2, 3, ..., 2. 


Proof: Syppose vz € [vi, ¥.. .--» Yea). Then is a linear combi- 
nation of ¥,. v2, ..., Ve--. Thus, the set {v,, v2, .... Ve-w Ye} IS LD. Hence, 
by Theorem 3.5.13 (b), {¥,, Va, .--» Vn} is LD 
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Conversely, suppose that {v,, v2, .... Ya} is LD. Consider the sets 
S, = {v,} 
S_ = (V4, Ve} 


S; = {v,, Ve, oeng vi} 


Sn = {¥1, Vey -.-) Vn} - 
By Theorem 3.5.9 (a), S,; is Li and by assumption S, is LD. So we go 
down the list and choose the first linearly dependent set. Let S, be that set. 
Then S, is LD and S;_, is Lt. Here2 < k <n. 
Since S; is LD, we have 
av; + XgVe +... + Q,Vv, = 0 » 

with at least one of the «a's not zero. Surely «, 4 0, for if a, = 0, then 
S,-, would become a linearly dependent set contradicting our statement 
that S, is the first linearly dependent set. Therefore, we can write 


Cpt 
v 


% = (— a) + (he + wt (= 


which means vz € [¥4, V2, ..-5 Ve-a)- 
3.5.15 Corollary A finite subset S = {v,, v3, .... Yn} Of @ vector space V 
containing a nonzero vector has a linearly independent subset A such 

that [A] = [S]. 

Proof: We assume v, #0. If S is Li, then there is nothing to 
prove, as we have A=S. If not, then, by Theorem 3.5.14, we have a 
vector v, such that vy. € [, ..., v4]. Discard v,. The remaining 
set S, = {¥,, ...5 Ves Vet» ---» Yn} has the same span as that of S (see 
Problem 4 (c), Problem Set 3.3). If S, is L1, then we are done. If not, then 
repeat the foregoing process. This must finally lead to a linearly indepen- 
dent subset A such that [A] =[S]. (Why ?) 

Example 3.32 Show that the ordered set {(1, 1, 0), (0, 1, 1), (1, 0, —1), 
(1, 1, 1)} is LD and locate one of the vectors that belongs to the span of 
the previous ones. 
Consider the sets 

S; = {(1, I, 0)} 

S, = {(1, 1, 0), (0, 1, 1)} 

Ss ae: {(I, l, 0), (0, l, 1), (1, 0, —1)} 

S, = {(1, 1, 0), (0, 1, 1), (1, 0, —1), (1, 1, 19}. 
Obviously, S, is LI. S; is also L1, because neither of the two vectors in S, 
is ascalar multiple of the other. S, is LD, because 

1(1, 1, 0), — 1€, 1, 1) — 11, 0, —1) = (0, 0, 0). 

Hence, (1, 0, —1) € [(!, 1, 0), (0, 1, 1}. S,isup, because of Theorem 
3.5.13 (b). 


3,5 LINEAR DEPENDENCE, INDEPENDENCE / 93 


Example 3.33 In Example 3.32 find the largest linearly independent 
subset whose span is [5,]. 

As proved in Example 3.32, (1,0, —1) € [(, 1, 0), (0,1, 1] and 
hence (1,"0, —1) € [(1, 1, 0), (0, 1, 1), (1, 1, 1). Therefore, we discard 
(!, 0, —1). The span of the remaining set A = {(I, 1, 0), (0, 1, 1), (1, 1, 1} 
is the same as [S,]. Now we check for the linear independence of 4A. 
Suppose 

a(1, 3,0) + 6(0, 1, 1) + y(I, 1, 1) = (0, 0, 0) 
or (a+y,2+B+y,B + x) = (0, 0,0). 


This means a + y = 0,2 +6+y7=0,8 + y = 0. Solving these equa- 
tions, we get only one solution, i.e. « = 0 = 8 =y. Hence, the set is x. 
Therefore, A = {(1, 1, 0), (0, 1, 1), (1, 1, 1)} is the largest linearly inde- 
pendent subset and [A] = [S,]. 

Finallyy let us extend the concept of linear dependence and linear 
independence to infinite sets. 


3.5.16 Definition An infinite subset S of a vector space V is said to be 
linearly independent (L1) if every finite subset of S is LI. 
S is said to be linearly dependent (LD, if it is not LI. 


Example 3.34 The subset 
S= 1, x, x*,.x7, «43 
of # is LI. 


For, suppose a,x") + agxs + 1. + a,xk» = 0 with ky, ke, ..., Kp being 
distinct nonnegative integers. Note that the equality is an algebraic 
identity, since the right-hand side is the zero polynomial. So, either 
by giving various values to x or by repeated differentiation of both 
sides of the identity, we get 

a, = 0=a,= sos = Gn. 


Problem Set 3.5 


1. Which of the following subsets S of V; are L1? 
(a) S = {(1, 2, 1), (—1, 1, 0), (5. =, 2)} 
(b) S = {(1, 0, 0), (1, 1, 1), (1, 2, 3)} 
(c) S = {(I, 1, 2), (—3, 1,0), 1, —1, 1), (1, 2, —3)} 
(d) S = {(1, 5, 2), (0, 0, 1), (1, 1, 0)} 
(ec) S = {(1/2, 1/3, 1), (0, 0, 0), (2, 3/4, —1/3)}. 
2. Which of the following subsets S of V, are LD ? 
(a) S = {(1, 0, 0, 0), (1, 1, 0, 0), (1, 1, 1, 1), (0, 0, 1, 1)} 
(b) S = {(1, —1, 2, 0), (I, 1, 2, 0), (3, 0, 0, 1), (2,1, —1, 0)} 
(c) S = {(1, }, 1, 0), (3, 2, 2, 1), (1, 1, 3, —2), (1,2, 6, — 5), 
(1, 1, 2, 1)} 
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(d) S = {(1/2, 2/3, 3/4, 4), (0, 0, 2, 0), (1. 2, 0, 1), (1/2, 2/3, 3/4, 4)} 
(ec) S = {(1, 2, 3, 0), (—1, 7, 3, 3), (1, —1, 1, —1)}. 
Which of the following subsets S of are L1? 
(a) S={x*-—1,x+1,x-}} 
(b) S = {l, x + x3, x — x’, 3x} 
(c) S = {x, x8 — x, xP 4- x*)x + x7 + x44 1/2} 
(d) S = {x* — 4, x + 2, x — 2, x7/3}. 
Which of the following subsets S of 4’ (0, ©. are 1.1? 
(a) S = {x, sin x, cos x} 
(b) S = {sin® x, cos 2x, 1} 
(c) S = {sin x, cos x, sin (x + 1)} 
(d) S = {in x, In x’, In x3} 
(ce) S = {x*e*, xe%, (x7 + x — 1)e*}. 
Prove that the vectors (a, 5), (c, d) are LD iff ad = be. 
Prove that 
(a) land iare Lp in the set C of complex numbers considered as 
a complex vector space 
(b) 1 and i are Li in the set C of complex numbers considered as a 
real vector space. 
Show that the set S = {sin x, sin 2x, ..., Sin mx} is a linearly indepen- 
dent subset of ‘4 [—*, x] for every posilive integer n. 


Prove Theorem 3.5.13. 
In the proof of Corollary 3.5.15 answer the question ‘why’. 
If u, v, and w are three linearly independent vectors of a vector space 
V, then prove that u + v, vy -++ w, and w + ware also LI. 
Find a linearly independent subset A of S in Problem | such that [A] 
== [S]. 
Proceed as in Problem 11 for the sets S in Problem 2. 
Proceed as in Problem 11 for the sets S in Problem 3. 
Proceed as in Problem 1]1 for the sets S in Problem 4. 
In Problems 1, 2, 3, and 4, whenever a set is LD, locate one of the 
vectors that is in the span of the others. 
True or false ? 

(a) {sin x, cos x, 1} is LD in & (0, 1). 

(b) {é+ J, i — Jj, 2i + 3/} is LD in V3. 

(c) If u,, ug, us, are LD, then 

OU, + ete + agus = 0 => one of the «’s is not zero. 

(d) Every set of three vectors in V, is LD. 

(e) A set of (wo vectors in V, is always LI. 

(f) If a vector v is a linear combination of 4, u., ..., %,, then 

{t, Ug, ..+) Un} iS LI. 
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(g) A subset of a linearly dependent set can never be Lp. 
(h) Every superset of a linearly independent set is LI. 
(i) x and |x| are in Y[I, 4]. 


3.6 DIMENSION AND BASIS 


We shall begin this article with the definition of a ‘basis’. 
36.1 Definition A subset B cf a vector space V is said to be a basis for 
V if 
(a) Bis linearly independent, and 
(b) [B] = V, 1.e. B generates V. 
Another definition of a basis, which is used by some authors, will be 
introduced as an equivalent property in Theorem 3.6.8. 
Example 3.35 Take V=V,. Consider the set B= {i, j, k}, where 
i=(1,0,0,j7 = (0, I, 0), & = (0, 0, 1). 
The set B is LI, because 
ai + Bi + yk = a(1, 0, 0) + B(0, 1.0) + y(0, 0, 1) = 0 = (0, 0, 0) 
implies that (a, 6, y) = (0, 0,0), ie. c=O=—B-=-y. Also B spans Vj, 
because any vector (x, Xs, x3) of V, can be written as a linear combination 
of i, j, and k, namely, (x, Xz, X3) = Xf + x,j + X3k. Hence, B is a basis 
for V3. 


It may be seen that the set B, = {(1, 1, 0), (1, 0, 1), (0, 1, 1)} is alsoa 
basis for V5, because any vector (x,, %,, X3;) € V; can be written as 


(X45 Mp, %y) = AEE Se 81, 1,0) + HE 81, 0,1) 
° de x3 
+ St%=%HO,1,1 
and a(1, 1,0) + BCI, 0,1) + 10, 1,1) = (0, 0, 0) 


implies « = O=8 = y, Le. B is LI. 


This example shows that a basis for a vector space V need not be 
unique. 

The two properties of a basis B, F game: (i) B is Lt and (ii) B gene- 
rates V are not entirely unrelated especially when B is finite. For, if a set 
B of n elements generates V, then we can prove, with some effort, that no 
linearly independent set can have more than ” vectors. This result is the 
content of the following important theorem. 

3.6.2 Theorem In a vector space V if {v,, V9, .... Yn} generates V and if 
{W,, We, -.) Wen} IS LI, then m <n. 

In ocher words, we cannot have more linearly independent vectors than 

the number of elements in a set of generators. 
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Proof: Let us adopt the following notations. If S is a finite linearly 
dependent ordered set of vectors 4, Mg, ... Up with u, +~ 0, then 
(i) by Theorem 3.5.14, there is a vector 4,2 <i <p, which is a linear 
combination of its predecessors. Let S’ denote the ordered set which 
remains after the deletion of such a u,; and 
(ii) for every vector w, let wS denote the ordered set {w, 1, Uz, ...5 Uy}. 
Now construct the set 
S, = {Wm Vi, Vas cory Va} ° 
S, has the following properties : 
(i) [S,] = V, because {¥, ..., 7,} spans V and w,, € V, 
(ii) S, is LD, since w, € V = [¥, Vg, .... Yn), and 
(iii) Wm # 0. 
So, applying Theorem 3.5.14, we see that S, can be formed by deleting 
vector v;, which is a linear combination of w,,, vi, v2, .. 5 Vs_1- 


Now consider the set S, = W,_, S;. Since S, spans V, S, also does so. 
Further, S, is LD, Since Wa_, € V = ([S,] and Wm, # 0. Therefore, by 
another application of Theorem 3.5.14, we form S;. Then we construct 
the set Ss = Wm.95, and continue the process of constructing new sets S 
and S’. Since the set of w’s is LI, every time the discarded element must 
bea v. 

If all the w’s are used up in this process, then m <n. Otherwise the 
set {Wm—ns Wm-_ntis «++» Wm-1. Wm} WOuld be Lp, which contradicts the linear 
independence of the w’s. § 


3.6.3 Corollary Jf V has a basis of n elements, then every set of p vectors 
with p > n, is LD. 
Proof: Suppose B = {vj, vg, «++, Mp} is a basis for V. Let A 
== {U, Us, . ., Up} be aset of p vectors,p > n. If A is Lt, then p <n by 
Theorem 3.6 2. Hence, A is Lp. § 


3.6.4 Corollary Jf V has a basis of n elements, then every other basis for V 
also has n elements. 
Proof: Suppose B, = {v,, v2,.., Vn} and B, = {w,, We, ... Wm} are 
two bases for V. Then B, and B, are 11 and [B,] = V, [B,] = V. 
Since [B,] = V and B, is Lt we have, by Theorem 3.6.2, m <n. Since 
([B,] = V and B, is Lt we get, by the same theorem, 1 < m. Thus, m= n.§ 


The number of elements in a basis is therefore unique and hence the 
following definitions. 


36.5 Definition If a vector space V has a basis consisting of a finite 
number of elements, the space is said to be finite-dimensional: the 
number of elements in a basis is called the dimension of the space and 
is written as dim V. If dim V = n, V is said to be n-dimensional. If 
V is not finite-djmensional, it is called infinite-dimensional. 
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If V = V, = {0}, its dimension is taken to be zero. 


3.6.6 Remark It follows from Corollary 3.6.4 that, if a vector space V 
is n-dimensional, (a) there exist ” linearly independent vectors in V 
and (b) every set of n + 1 vectors in V is Lb. 


Example 3.36 V, is 2-dimensional, because (1, 0) and (0, 1) form a basis 
for Vz. V, is 3-dimensional, because V, has a basis of 3 elements, namely, 
i,j, and k. 
V,, is n-dimensional, for, consider the elements 
e, = (1, 0, 0, ..., 0) 
e, = (0, 1, 0, ..., 0) 


e, = (0, 0, 0, ..., 1) . 
with e; as the vector, all of whose ccordinates are zero except the i-th, 
which is 1. It is easy to see that ¢,, ¢,, ,é@, are Li and every n-tuple is 
a linear combination of @,, @, ..., @n« 

Thus, the set {e,, e,, ... , @n} is a basis for V,. The basis {e1, eg, ...» @n} 
is called the standard basis for V, and will be used in the sequel without 
any further mention. In particular, note that {i, j, k} is the standard basis 
for Vz. In other words, 

e, =(,0,0) =i 

Cy = (VU, I, 0) = Jj 

e, = (0, 0, D=k 
Example 3.37 Find the dimension of the space fy. 


Every polynomial in 9, is a linear combination of the functions 
1, x, x’, ....x®. Further, this set is LI. (Why ?) Hence dim 9, = n + 1. 


3.6.7 Theorem Jn an n-dimensional vector space V, any set of n linearly 
independent vectors is a basis. 


Proof: Suppose B = {¥,, va, ..., Yn} is a set of n linearly indepen- 
dent vectors. To prove that B is a basis we have only to show that B 
spans V. 

Take VE V. The set {v,, v2, ...» Vay V} IS LD, because V is n-dimen- 
sional (cf Remark 3.6.6). Hence, by Theorem 3.5.14, one of the vectors 
Vo, Vg. «ss Vn, SAY VY, iS in the span of all its predecessors. Obviously, this 
one cannot be-any one of ¥,, V5, ..., Vn, for in that case we shall be contra- 
dicting the linear independence of {v,, Vg, ..., Yn}. Hence, v € {¥1, Vg, «+9 Val. 
Therefore, B spans V. §j ‘ 
Example 3.38 Prove that the set {(1, 1, 1), (1, —1, 1), (0, 1, 1)} is a basis 
for V3. 

To prove this we have to prove only that the set is L1, because V, is 3- 
dimensional, Suppose 
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a(1, 1, 1) + BUI, —1, 1) + (0, 1,1) = (0, 0, 0) 
or (a+Ba—B+y,e+8 + 7) = (0, 0,0). 
Soat+B=u,2—B+y=0,e0+68+7=0. These equations give 
«=0=8=y. Hence, the set is 11 and is therefore a basis for Vs. 

We shall now take up the theorem referred to immediately after Defi- 
nition 3.6.1. This theorem gives rise to the definition of a basis used by 
some authors (see Remark 3.6.9). 

3.6.8 Theorem ‘Jn a vector space V let B = {y,, Ve, ..., Vn} span V. Then 
the following two conditions are equivalent : 
(a)  {¥, Vay...) Va} ts @ linearly independent set. 
(b) If v E V, then the expression v = a,V, + &W_ + ... + Sqn Is 
unique. 
Proof: .Assume (a). We shall prove that any expression for v in 
terms of ¥,, Vs, ..., ¥, is unique. For, if 


V = OV, + &gWy + ... + Onn (1) 
and also 

= BY, + Bava +... + Ban ’ (2) 
then Vy + Avy +... + OnVy = BV, + Bava 4 --. + Ban 
or (a, — By)va + (%, — Ba)vg +. - + (Xn — Barn = 0. 


But the v,’s are LI, so «, — 8, = 0 for all i. This gives «, = 6, for all i and 
hence expression (1) is unique. 
Conversely, assume (b). Suppose now that the v,’s are not LI, i.e they 
are LD. Then there exists a nontrivial linear combination, say 
Byvy + Beg + ..- + Bava » (3) 
which equals the zero vector. But 0, on the other hand, is already equal 
to the trivial linear combination 
Ov, + Ovy + .-- + Ov,. (4) 
Thus, we get two different expressions, (3) and (4), for 0. This contradicts 
(b). Hence, {v,, vp, «+, Va} is Li. § 
3.6.9 Remark Note that the foregoing proof can be adopted for infinite- 
dimensional cases also. 
Further, note that a basis B has two properties : 
(i) Bis tt and 
(ii) [B] = V. 
Hence, the following conclusion is obtained : ‘A set B is a basis for a 


vector space V iff [B] = V and the expression for any v € V in terms 
of elements of B is unique.’ 


We now define the term coordinate vector, 
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3.6.10 Definition Let B = {v,, v,, ..., v,} be an ordered basis for V. Then 
a vector vy € V can be written as vy = a,y, + @,¥, +... + av, The 
vector (a,, %, ..., %) is called the coordinate vector of v relative to the 
ordered basis B. It is denoted by [v]z. «,, a, ..., %, are called 
the coordinates of vector v relative to the ordered basis B. 

The coordinates of a vector relative to the standard basis are simply 
called the coordinates of the vector. 
It should be noted that [v]zis unambiguously fixed in view of Remark 

3.6.9. 


Example 3.39 Find the coordinate vector of the vector (2, 3, 4, —1) of. 
V, relative to the standard basis for V,. 

The standard basis for V, is {e,, e, €s, @,}, where e, = (1, 0, 0, 0), 
e, = (0, 1, 0, 0), eg = (0,0, 1,0), and e, = (0,0, 0,1). Obviously, 
(2, 3, 4, —1) = 2e, -+ 3e. + 4e, — le,. So the coordinate vector of 
(2, 3,4, —1) relative to the standard basis is (2, 3,4, —1). Therefore, 
2, 3, 4, and —1 are the coordinates of the vector (2, 3, 4, —1). 

If the reader finds that this example is not very illuminating, he should 
study the following example. 
Example 3.40 Find the coordinates of (2,3,4, —1) relative to the 
ordered basis B = {(1, 1, 0, 0), (0, 1, 1, 0), (0, 0, 1, 1), (1, 0, 0, 0)} for Vy. 
(The reader can verify for himself that B is a basis for V,.) To get the 
coordinates of (2, 3, 4, —1) relative to B, we write 


(2, 3, 4, —1) = a(1, 1, 0, 0) + B(O, 1, 1, 0) + (0, 0, 1, 1) + 6(1, 0, 0, 0) 


or (2,3,4,-D=(+5,«+ 68,8 + ¥,¥). 
This gives «+5=2,4e+8=3,8 +y=4,7 = —I1. Solving these 
equations, we get « = —2, A= 5, y= —l,and&5=4. Hence, the co- 


ordinates of (2, 3, 4, —1) relative to the ordered basis B are —2, 5, —1, 
and 4. (—2, 5, —1, 4) = [(2, 3, 4, —ID)]a. 
We now prove a theorem on the extension of a linearly independent set 
to a basis for a vector space V. 
3.6.11 Theorem Let the set {v,, vs, ..., Vx} be a linearly independent subset 
of an n-dimensional vector space V. Then we can find vectors 
Vetz> «+0y Vn it V such that the set {v,, -- » Viv Veris **» Va} is @ basis 
for V. 
Proof: By Theorem 3.6.2, k <n. If k =n, then, by Theorem 
3.6.7, {Vis Vay o-*> Varma} 18 a basis for V. If & <n, then {V1, Vay +o-) Va} is 
not a basis for V (Corollary 3.6.4). But the set {v,, Vg, ->-, Ve} is LT. 
Therefore, [¥,, Yq. «--» Ve] # V. Hence, [¥,, vg, ++, Ya] is a proper subset of 
V. Thus, there exists any nonzero vector vg+, in V such that ver, & 
[vy, Vg «++» Vale 
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Hence, the set {v,, V9, «Ve» Yeti} is LI; otherwise, by Theorem 3.5, 14, 
one of the vectors Vo, Y%> ++) Ye» SAY Yitr is in the span of all its 
predecessors. 

Now, if k + 1 =, we are done. If not, we repeat the foregoing 
process until we get nm linearly independent vectors {v;, Vg. ..., Vis 
Vity «+ » Yn}. This forms a basis for V by Theorem 3.6.7. J 


3.6.12 Remark We can produce any number of bases, because we can 
start from any nonzero vector and extend tt. 


Example 3.41 Given two linearly independent vectors (1, 0, 1, 0) and 
(0, —1, 1, 0) of V,, find a basis for V, that includes these two vectors. 
[(1, 0, 1, 0), (0, --1, 1, 0)] = {(«, —B, « + B, 0) | «, B any scalars}. 

As in Theorem 3.6.11, so too now we choose a vector outside this span 
and get an enlarged linearly independent set. 

Since the fourth coordinate is always zero fur vectors in this span, 
certainly (0, 0, 0, 1) is not in this span. Thus, we get an enlarged linearly 
independent set {(1, 0, 1, 0), (0, —1, J, 0), (0, 0, 0, 1)}, whose span is 
[(1, 0, 1, 0), (0, —1, 1, 0), (0, 0, 0, 1)) = i(a, - B,« + By) 1], 8,7 are 
scalars}. Now we have to identify one element outside this span. Given 
a, 8, y, the third coordinate in the elements of this span is always « + 8. 
So we shall look for a vector for which this is not true. Clearly, 
(1, —2, 0, 0) is not in the span of the earlier set. So we have a set 

B = {(1, 0, 1, 0), (0, —1, 1, 0), (0, 0, 0, 1), (1, --2, 0, 0}, 
which is Lt and, by Theorem 3.6.7, it is a basis for V,. The reader is 
advised to verify that this is indeed a basis. 

Example 3.42 Let {(1, 1,1, 1), (1, 2, 1, 2)} be a linearly independent subset 
of the vector space V,. Extend it to a basis for V,. 

We have 

CC, 121, 1,), (1, 2, 1, 2)) = {(@ + Be + 28, « + B, 

a -+ 28) | «, B are scalars} . 
Since the first and third coordinates are equal for all vectors in the span, 
we find that (0, 3, 2, 3) is not in the span. Thus, we have an enlarged 
linearly independent set {(1, 1, 1, 1), (1, 2, 1, 2), (0, 3, 2, 3)}, whose span is 
(I, 1, I, 1), (I, 2, I, 2), (0, 3; 2, 3)] oom {(a ss B, a -f 2p + 3y, a+ 6 + 2Y; 
a -+ 28 + 3y | «, B, y are scalars} . 
Obviously, the vector (2, 6, 4,5) is not in this span. Hence, the set 
{(1, 1, I, 1), (1, 2, I, 2), (0, 3, 2; 3), (2, 6, 4, 5)} is Li. Thus, by Theorem 
3.6.7, it is a basis for V,: 
We shall now prove two theorems on dimensions of subspaces. 


3.6.13 Theorem Let U be a subspace of a finite-dimensional vector space V. 
Then dim U < dim V. Equality holds only when U = YV. 
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Proof: Let B= {y, v,, ..., Vn} be a basis for VV. This generates V 
and has 7” elements. Any set of linearly independent vectors in V and 
therefore any set of linearly independent vectors in U cannot have more 
than n vectors. Therefore, dim U < dim V. 

When dim U = dim V, B,, a basis for U, is a set of n linearly indepen- 
dent vectors of V, whose dimension is also n. So, by Theorem 3.6.5, it 
follows that B, is a basis for V. This means V = [B,] =U. 


3.6.14 Theorem If U and W are two subspaces of a finite-dimensional 
vector space V, then 


dim (U + W) = dim U + dimW -- dim(U Q W). 
Proof: Let dim U = m, dim W = p, dim (U (\ W) = r, and dim 
V=n. By Theorem 36.13,m<n,p<n,r<n. Let {v, v,, --, ¥y} be 


a basis for U(\ W. This is a linearly independent set in UC W and 
therefore in U as well as in W So it can be extended to a basis for U , say 


{v,, Vag cea Pry Upety veny Umt e)) 
and to a basis for W, say 
{v,, Vox «+ 9 Very Wry sory Wo} : (6) 
We shail now prove that the set 
A= "1, Van sey Vey Urtiy vey Urny Wrtgy cory Wp} (7) 


is a basis for U + W. In fact, this will complete the proof of the theorem, 
because in that case, the dimension of U + W will be the number of 
elements in A, i.e. r + (m—r)+(p—r)=m-+p--r. This is what the 
theorem asserts. 

To prove that A is a basis for U + W, we have to prove that (a) A is 
Liin U + W and (b) [A] = U + W. To prove (a) let us assume that 


r m P 
2 av, + 2 Buu, + p>» YwW= VU. (8) 
i=l i=r+l i=r+l] 
This gives 
Fr m Pp 
2 Op + 2 Bu, =— 2 Yes (9) 
i=] i=rt+l i=r+] 
= y, Say. 


The vector v is in U, because the left-hand side of Equation (9) isin U.  v 
is also in W, since the right-hand side of Equation (9) is in W. Thus, 
vE UW. Therefore, vy can be expressed uniquely in terms of 
Vis Van seoy Vee Thus, 


r 
po 2 5,, (10) 
f=] 


for suitable 5’s. Hence, 


r P 
p> 5); a Dy YW, = 0. (1 1) 
i=] i=r+l 
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But {¥,, Vay +5 Ves Wetis «++» Wy} iS LI. So each of the 6,’s and y,’s is Zero. 
Substituting y+; = Yr+2 = --- = Yp = 0 in Equation (9), we find that 


r m 
2 ay+ BS Pu = 0. (12) 
i=] i=r+] 


Again, {¥1, «+; Yr, Urtys «++» Um} is LI. So each of the a,’s and £,’s is zero. 
Thus, Equation (8) implies that each scalar involved is zero. Hence, 4 :s 
LI, which proves (a). 
To prove (b), let z€ U+W. Then z =u -+-w, where u € U and 
wEW. This gives 
r m r p 
z=ZDay+ 2 Butsay + 2 Bw, (13) 
i=l i=r fl i=] i=r+l 
for suitable scalars «,’s, 8,’s, %,’s, 6;’s. Simplifying expression (13), we see 


that z€ [A]. Hence, U +} WC [A] The reverse in equality is obvious, 
because A C U + W. 


3.6.15 Corollary Jf U and W are subspaces of a fimte-dimensional vector 
space V such that U (\ W — {0}, then 
dim (U ® W) = dimU + dimw. 

The proof is obvious and is left to the reader. 

As illustration, take U = the xy-plane and W =the yz-plane in V5. 
Clearly, U and W are subspaces of V, and dim U = 2, dim W = 2. 
U (\ W = y-axis, whose dimension is 1. By Theorem 3.6.14, we have 

dim (U + W) = dim U + dim W — dim (U(Q) W). 
But U + W, in this case, is V3. So 
dim V, = (xy-plane) + dim (yz-plane) — dim (y-axis) 
or 3=2+2-—1. 
This verifies the result of Theorem 3.6.14. 

On the other hand, if we take U = xy-plane and W = z-axis, then 
UW = {0}andU + W=/YV,. Also, 

dim V, = dim (U @ W) = dim U + dim WV, 
or 3=2+1. ; 
This verifies the result of Corollary 3.6.15. 


Now we give a comprehensive example which illustrates different ideas 
studied in this chapter. 


Example 3.43 Take V = $,, the space of all real polynomials of degree at 
most 3. Let U be the subspace of ?, consisting of those polynomials of 9, 
that vanish at x= 1. Let W be the subspace of , consisting of those 
polynomials of ?, whose first derivatives vanish atx = 1. Study the sub- 
spaces U, W, U () W, U + W in terms of dimension, basis, and the exten- 
sion of each of these bases to a basis for V = 9,. 
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Let p stand for an arbitrary polynomial. Recall that R stands for the 
set of real numbers. Then 
== {p | degree of p < 3} 
= {a + Bx + yx” + Bx* | 0,8, 7,5 € R}. 
We know that dim V = 4. Also 
U ={p & V | p(t) = 0} 
={e+6x+yxr4+8xFlatpBtyth =0; 
“8,7,5€ R} 
= {(—B — y — 8) + Bx + yx? + 5x* | 8, 7,5 E R} 
= {B(x — 1) + x(x? — 1) + B(x? — 1) |B, ,8 © R}- 
This shows that the set {x — 1, x*? — 1, x? — 1} spans U. Since it is 
easily seen that this set is LI, it also forms a basis for U. So dim U = 3. 

This basis can be extended to a basis for V == 9, by taking another 
element that is not in the span U of these polynomials. Such a polynomial 
is a constant polynomial, say 1. Thus, by Theorem 3.6.7, {1, x — 1, 
x? — 1, x5 — 1} is a basis for VV = 9,. Again, 

={peV|p(l) =9 

= {a + Bx + yx? + 5x® | 6 + 2y + 35 = 0; 2,8, 7,6 € R} 

== {a + y(x* — 2x) + &(x* — 3x) | a, 7,8 € R}. 
This shows that W is spanned by {1, x? — 2x, x*° — 3x}. Since this can be 
shown to be LI, it follows that {1, «7 — 2x, x® — 3x} is a basis for W and 
dim W = 3. 

The extension of this basis to a basis for P, 1s got by looking for just 
one vector that is not in W. Such a vector is a polynomial x. Thus, 
{1, x, x? — 2x, x® — 3x} is a basis for f,. Again, 

UNW={Pe PZ, | p(!) = 0, p'(1) = 0} 

= {a+ Px + yx? + 5° (2+ B+ 7+5=0, 

B+ 2y + 35 = 0; a, 8, y,5 € R} 

= {y(l — 2x + x*) + 82 — 3x + x) [7,5 € R}. 
Clearly, 1 — 2x + x* and 2 — 3x + x*areui. So dimU M W =2 and 
{1 — 2x + x*, 2 — 3x + x*} is a basis for UM W. Now we look for 
elements that are not in U 1) W. One such element is x*. Now consider 
the span of the linearly independent set {1 — 2x + x, 2 — 3x + x°, x*}. 
The span of this set is still not V, because dim V = 4. So look for one 
more element outside this span. One such element is x*°. (Why? Can 
you find others 7) Hence, 

{1 — 2x + x7, 2 — 3x + x5, x7, x*} 

is a basis for V. Finally, 


U+W={p+q|pEeu,qe W} 
== {a,(x — 1) + a,(x* — 1) + a(x? — 1) +B, 
+ Byfx® — 2x) + Ba(x* — 3x) | a1, Ma, Os, Ba, Par By E RR}. 
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So B = {(x — 1), (x? — 1), (x? — 1), 1, (x® — 2x), (x* ~ 3x)} spans the 
spaceU + W. But 
dim (U + W) = dim U + dim W — dim (U N W) 
=3+3-2=4. 
Therefore, B is LD. Applying Theorem 3.5.9 to the ordered set C 
=: {1,x — 1, x? — 1, x? — 2x, a? — 1, x? — 3x}, which is Lp, we find 
that x? — 2x € [l, x — 1, x? — 1], for 
x® — 2x = I(x* — 1) -- 2(x — 1) — 1(1). 
Hence, x? — 2x can be discarded. We are thus left with the set 
C’ = {l, x -- 1, x7 -- 1, x* -- 1, x3 — 3x}, 
which has 5 elements. This 1s still LD (since dim (U + W) = 4). Again, 
by Theorem 3.5.9, there exists a vector that is a linear combination of all 
its predecessors. It cannot be | or x -- | or x* -- 1 or x* — 1, since these 
four are Li among themsclves. So let us check whether x® — 3x is a 
linear combination of its predecessors. We have 
x® — 3x = 1(x® — 1) + O(x? — 1) — 2(x — 1) — AM). 
Hence, 2° — 3x € [I], x —1,x° —1,x° — 1] So x’ -- 3x can be dis- 
carded. We arc thus left with the set 
D={lx-—1,2-1,¥8— 1}, 
which is obviously a basis for U + W, Since dim (U + W) = dim V = 4, 
we get U + W -= V, by Theorem 3.6.13. 


Problem Set 3.6 


1. Which of the following subsets S form a basis for V,? Incase S is 
not a basis for V,, determine a basis for [S]. 
(a) S fe {(l, 2, 3), (3, I; 0), (=:2, I, 3)} 
(b) S= {(1, 1, J), (1, 2, 3), (—1, 0, 1)} 
(c) S = {(0, 0, 1), (1, 0, 1), (1, 221, 1), (3, 0, 1)} 
(d) S = {(1, 2/5, —1), (0, l, 2), (3/4, —1, 1)} 
(e) Ss = {(—1, 3/2, 2) (3, 2/3, 3)}. 
2. Which of the following subsets S form a basis for the given vector 


space V ? 
(a) S = {(1, —1, 0, 1, (0, 0, 0, 1), (2, —1, 0, 1), (3, 2, 1, 0)}, 
V = V, 
(b) S oe {(0, l, 2; L), (1, pe —I, 1), (2, —3, l, 0), (4, —2, —7,—5)}, 
V=V, 


() S={x-1xX®+x-12-—x+),V=9, 

(d) S = {1, x, (x — Dx, x(x — 1)% — 2)},V = J; 

(ec) S = {1, x, (3x* — 1)/2, (5x*—3x)/2, (35x — 30x* +. 3)/8}, 
V= & 

() S=(l,x—2,(e—2%(7-2HV =I, 


10, 


11. 


12, 
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(g) S = (I, sin x, sin’ x, cos? x},V = ¢[—n, m] 

(bh) S={(1,4,14+0,(0,41—0,¢, -6 DLV = VE. 
Determine the dimension of the subspace [S] of V, for each S in 
Problem 1. 


Determine the dimension of the subspace [S] of V for each S§ in 
Problem 2. 
Extend the set {(3, --1, 2)} to two different bases for Vj. 
Given S, = {(I, 2, 3), (0,1, 2), (3,2, 1)} and S, = {(1, —2, 3), 
(—1, 1, —2), (1, —3, 4)}, determine the dimension and a basis for 
(a) [5S] 0 ([S,] (b) [S,] +- [53]. 
Given S as a finite subset of a vector space V, prove that 
(a) If Sis Li and every proper superset of S in V is Lp, then S is a 
basis for V. 
(b) If S spans V and no proper subset of S spans V, then S$ is a 
basis for V. 
Find a basis for a subspace U of V in the following cases : 
(a) U={pe 9,|p" =0},V =F, 
(b) U={pE€ Ps | p(x) = p(x) = O}F,V= Fs 
(c) U = {(X1, Xa, ---, Xn) E Va | yxy... -F Onn == 03 4, 202, Oy 
are any n scalars}, V = V,, 
(4) U = {(x,, 2, Xs ta Xs) E v, PL e ee °}. 
VY = V, 
(e) U= {p€& Pg| plxo) = 0}, Vi= Vy. 


Let U and W be two distinct (2 — 1|)-dimensional subspaces of an 
n-dimensional vector space V. Then prove that dim (U CQ W) 
=n — 2, 
(a) Prove that every I-dimensional subspace of V, is a straight line 
through the origin. 
(b) Prove that every 2-dimensional subspace of V, is a plane 
through the origin. 
(c) Deduce that the intersection of two distinct planes through the 
origin is a straight line through the origin. 
Let v,; = ae, — a,e,, i = 1,2, ..-,m, and for a fixed k(<n), be n 
vectors of V, with a, 4 0. Then prove that v,, Va, -++, Vays Verne o**s 
y, isa basis for U of Problem 8(c). , 
Find the coordinates of the following vectors of V, relative to the’ 
ordered basis B = {(2, 1, 0), (2, J, 1), (2, 2, I}: 
(a) (I, 2, 1) (b) (—1, 3, 1) (C) (X4, Xgy X3) 
(d) (~V2,%,e) (e) (—1/2, 1/3, 5) (f) (2, 0, —1). 
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13, 


14. 


15. 


16. 
17, 


Find the coordinates of the following polynomials relative to the 
ordered basis {1 — x, 1 + x, 1 — x*} of 9,: 
(a) 3+ 7x +2x? (b) x — 3x? (c) x®+4+2x—1. 
Find an ordered basis for VY, relative to which the vector 
(—1, 3, 2, 1) has the coordinates 4, 1, —2, and 7. 
Let B, = {¥,, Ve oy Va} and By == {u,, My, -+-) Mn} be two ordered 
bases for an n-dimensional vector space V and let 

Uy = 0 yVy tH Fg Vg TP +e HF Bn Vn 

Ug == OQ 1 hy TP +e) fF OngMs 


Un = BinVy + hgnVe To. + Onnla. 
Then find the coordinates of a vector v € V relative to the basis B,. 
if its coordinates relative to the basis B, are X,. Xe, +, Xn 
Find the dimension of V:° 
Construct two subspaces A and B of V, such that dim A = 2, 
dim B = 3, and dim AQ) B = 1. 
Let B, = {t,, tl, ..., Up} and B, == {¥,, ve, .... Vat be ordered bases 
for an n-dimensional vector space V such that {u, — v,, u4, — Vz, -, 
Uy, — ¥,}1SLD. Then prove that there exists a nonzero vectoru € V 
such that [ule = [u]p,. 


. True or false ? 


(a) Every vector space has a finite basis. 

(b) A basis can never include the zero vector. 

(c) If two bases of V have one common vector, then the two bases 
are the same. 

(d) If every set of p vectors of V withp > nis Lp, then V has a 
set of m generators. 

(ec) A basis for V, can be extended to a basis for V4. 

(f) A basis for Vi is{é+f+t+k,it+ J, i. 

(g) A basis for §, is {1, 2x, (x — 1)*}. 

(h) A set of generators of 9, is 

{(x — 1), (x — 1), (x — 1. x? — 1, I}. 

(i) [v]z is independent of B. 

(j) {(1, 0, 0), (0, 1, 0), (0, 0, 1)} is a basis for the complex vector 
space VC, 

(k) In V,, if (2, 3) is the coordinate vector of (2, 3) relative to the 
ordered basis B, then B is the standard basis. 


Chapter 4 


Linear Transformations 


The significance of vector spaces arises from the fact that we can pass 
from one vector space to another by means of functions that possess 


a certain property called linearity. These functions are called linear 
transformations. 


4.1 DEFINITION AND EXAMPLES 


4.1.1 Definition Suppose U and V are vector spaces either both real or 
‘both complex. Then the map 7: U — FV is said to be a /inear map 
(transfoi mation, operator), if 

T(u, + u,) = T(u;) + T(ue) for all u,, u, E U (1) 

and 7(au) — «T(u) for allu € U, and all scalars «. (2) 

A linear map T: U — U is also called a linear map on U. Whenever 

we say 7: U-+ V is a linear map, then U and V shall be taken as vector 
spaces over the same field of scalars. 

4.1.2 Remark In Definition 4.1.1 the ‘plus’ in u, + u, denotes the addi- 
tion in space U, and the ‘plus’ in T(u,) + T(u,) denotes the addition 
in space V. We shall not elaborate these delicate points in the sequel. 
A similar remark is true for the two scalar multiplications implied 
in Equation (2). 

Example 4.1 Define T: V, -> Vs by the rule 

T (Xt. Xay Xp) = (1s Xe» 9) - 
It is called the projection of V, on the x,xs-plane. To prove that it is a 
linear map, we have to show that 
T(x + y) = T(x) + TO) and Tox) = a7 (x) 
for all x, y & V,and all scalars a. Let x = (x, Xg, Xs) and y = (1s Ya» Ya): 
Then 
xy = (Xt Yi Xe + Ver Xs + ys) 
and GLX == (ON, Ny, AXy) « 
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Now, by definition of 7, we have 
T(x + y) = T(x, +¥1) Xa + Vas Xa + Ya) 
= (x, + Yi, %y + Ye, 0). 
On the other hand, 
T(x) + Ty) = T(xX1, Xe. Xs) + TO 1s Yes Ys) 
= (%, X35 0) + (1; Yes 0) (definition of T) 
== (%, + Jas Xe + Ye» 0) (addition in V,). 
Thus, T(x + y) = T(x) + Ty) for all x, y € Vs. 
This verifies one requirement for the linearity of 7. Again, 
T(2x) = T(axy, 2X2, &X3) 
== (2X), &%5, 0) (definition of 7’) 
= O(Xy, Xe, 0) (scalar multiplication in V5) 
and 
aT(x) == aT X,, Xe. X3) = 2(X1, X2, 0) (definition of 7). 
Thus, T(xx) = «7(x) for all x € Vy and all scalars «. 
Hence, both the conditions for linearity of T are verified. So T is linear. 
The reader should note that we have gone through the verification 
rather leisurely. We shall not be able to afford such a leisurely pace in 
the sequel. But every time we say that a map js linear the student would 
do well not to take it for granted but 1qather to go through the verification 
in as much detail as his understanding demands. 


Example 4.2 Define T: V, -> V, by the rule 
T(X3, Xgy Xs) = (X, — Xa, Xy + sq). 
This is a linear map as we shall now show. 
If x = (x1, X2, X3) and y = (1, Ye, Ys), then 
T(x + y) = T(x + Vas Xa + Yas X3 + Ya) A 

= (%, + Vy — Xe — Vor X% + Vy + X3 + Vs); 

whereas 
T(x) + Ty) = (1, — Xp Xy + Xs) + a — Yas Yi + Yad 

= (X, — Xg + V1 — Vay Xy + OX 4- YW, + Ya) 

== (xX) + Vi — X2 — Vos Xy +, + X35 + Ya). 
Hence, 7(x + y) = T(x) + TQ) for all x, y EG Vs. The remaining part, 
namely, 7(ax) = «7(x) can be completed by the reader. Then it will 
follow that 7 is linear. 
Example 4.3 Define T : V; —> V, by the rule 

T(%1, Xg, Xg) = x3 + x9 + x}. 
This is not a linear map, because for x = y == (1, 0, 0) 
T(x + y) = (X +)? + (Xs + a)? + (Xe + ys)? = 4, 
whereas 
Tx)+ Ty) =xit+axitxdtyi tt yh t+ yi = 2. 

Note that even if one of the two requirements of the definition of linearity 
fails, T is not linear. 
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Example 4.4 Define T: U-» V(U and V being vcctor spaces) by the 


rule 

T(u) = Ov 
for allu € U. This is a linear map. It is called the zero map, because it 
maps every vector to the zero vector of V. 
Example 45 Let U bea vector space. The identity mop lu:U—+>U 
defined by the rule 


fu(u) == u 
is also linear. 


Example 4.6 Define T: V,-—> V, by the rule 
T(x, Xs) = (X}, —x;) . 
This is a linear map and is called the reflection in the x,-axis (Figure 4.1). 
X9 


FiGureE 4 | 


Example 4.7 Define D: ¢& (a, b)-> ¢ (a, b) by the rule 

D(f)=f', 
where /” is the derivative of f. The facts that D(f + g) = (f+) =f’ + 2’ 
and that D(af) = (af)’ = 2f’ are elementary but important results in 
calculus. In view of these results, we see that Dis linear. This trans- 
formation D is called the differential operator. 


Example48 Define J: / (a, b) > R by the rule 


b 
MP) = SI) ae. 
a 
Again, by the properties of integral, we find that J is a linear map. 
Example 4.9 Suppose u, * 0 is a fixed vector of a vector space U. 
Define 7: U -> U by the rule 
T(ix)=x+ uy 
for allx € U. This map T is not linear, because 
T(x + y) = (x + y) + uM 
A li i Ml 
This map is called translation by the vector u,. 
4.1.3 Remark The function f: R — R defined by f(x) = x in a (‘a’ fixed) 
is customarily called a linear function, because its graph in the xy- 
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plane is a straight line. But it is not a linear map from the vector 
space V, to itself, in the sense of Definition 4.1.1. 
4.1.4 Theorem Let T: U -> V bea linear map. Then 
(a) T(0,) = 0,, (b) 7(—u) = —T(u), and 
(Cc) Tlayuy -b 12. + &aMy) = 0,7 (u,) + ... + an (u,). 

In other words, a linear map 7 transforms the zero of U into the zero 
of V and the negative of every u € U into the negative of T(u) in V. 

The proofs of (a) and (b) are left to the reader. The proof of (c) is 
obtained by induction on ‘n’, starting from the fact that T(au) = «7(u) and 
using the property 

T(au, + Buy) -= T(au,) + T(Bu,) = «7 (u,) + BT(u,) . 

In view of (c), we get u standard technique of defining a linear trans- 
for.nation 7 on a finite-dimensional vector space. Suppose B = {u,, us, ..., 
u,}isabasisforU Then any vector u € U can be expressed uniquely in 
the form 

U= 0,4, + ou, +... 4+ Onn . 
So, if 7: U - Visa linear map, then 
T(u) abe (au, ae Lally + eee - Xn) 
= a, T(u;) + aT (uy) +... a, T(u,) . 

Thus, Z(u) is known as soon as T(u,), T(t), ..., T(un) are known. This 

is formalised in the following theorem. 
41.5 Theorem A linear transformation T is compeltely determined by its 
values on the elements of a basis. Precisely, if B = {u, Ug, ..., Un} Is 
a basis for U and y,, Ys, ++ » Y, be n vectors (not necessarily distinct) in 
V, then there exists a unique linear transformation 
T:U0->V 


T(u,) = v, fori = 1,2,..,%. (3) 


Proof: Letu€ U. Then u can be expressed uniquely in the form 
U = OU, + Ot, +... + XpUn . 


T(u) == %V, + %Qve + ... + On, . (4) 
We now claim that this transformation T is the required transformation. 
To prove our claim, we have to show that (i) T is linear, (ii) T satisfies 
Equation (3), and (iii) T is unique. 
(ii) is obvious, since u, = Ou, + .-. + Ou;-,; + lu, + ... + Ou,, and so 
T(u,) = lv, = v, for all i. 
(iii) follows, because if there were another such linear map S with 
S(u,) = v,, then 
S(u) = S(a,ty + atlg + one + SnUn) 
== 0, 9(t4,) + %gS(ug) + .-. + O%_S(U_) (S is linear) 
= Vy + ZV, +. + ny 


== J(u). 


such that 


We define 
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This is true fo. everyuG U0 SoS =T. 


It only remains to prove (1), which is just a verification of the two 
relations 
T(u -+ v) = T(u) + 7(v) and 7(au) = «T(u) 
for arbitrary u, v€ U and all scalars a Let u, v be two vectors of U. 
Then 
Ui = Ay + oe + Onin, Vv = Bu, + ... + Bu, 
and we have 
u-+-yv= (a, -{- Biju, te ses + (a, -- Bun . 
Hence, by the definition of 7, we have 
: T(u + vy) = (a, +- Bi)vy + oe (Xp =f Ba)¥n . 
Also, = T(u) -F T(v) = (ay, + ee + tan) + (BY Foe Buta) 
— (a, -{- By a ae eA Bn . 
Therefore, T(u + v) = T(u) + T(v). Again, 


T(au) = aay, -f... foxy, 
= oftr,y, be <x aa¥) 
= aT (u) : 


Thus, T is linear and the theorem is proved. §f 


4.1.6 Remark Theorem 4.1.5 will be used in the following way: To de- 
fine a linear map, very often we shall be content with listing 
T(u;), T(u,), .. , Tuy). This means the value of T on a general u is 
to be obtained by the precess shown in the theorem, namely, if 

Ui OU, + Ally +... 1 Ayn, 
then 
T(u) = 0% T(uy) 4- aT(ug) +... + OnT (Un) - 
This process of defining J on the basis and extending it to the re- 
maining elements is called linear extension cf T. So we shall simply 
say ‘Define T on a basis and extend it linearly’ or, equivalently, 
‘Define the linear map T by specifying its values on a basis’. 

Example 4.10 Suppose we want to define a linear map 7: V, —-> V,. 

Take a basis for V,, say {(1, 1), (1, —1)}. We have only to fix 7(1, 1) 

and 7(1, ~--1) in V4. Infact, every ordered pair of vectors in V, will give 

us one linear map 7. We shall cite a few in Table 4.1. 


TABLE 4.1 
Linear map > tS . ; ; 
Value at T . 8 é 
+ 
(1, 1) (0,0,0,0) (0,1,0,0) (1,1,1,1) (1, 1, 0, 0) 


(i, —1) (0,0, 0,0) (1, 0, 0, 0) paar, (0, 0, 0, 0) 
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Let us now linearly extend each of these maps to anyw€ VY, The 
actual values of 7(u) will depend on the coordinates of wu relative to the 
basis {(1, 1), (1, — 1)}. 

Let u= (x,y) E V,. Then 


(x,y) =" 2 a,0 +20, -p. 


Thus, we get 
T(x, y) = a 7, 1, D+" T, (i, —1) 


Ter eee = 0, 0, 0, 0) 


= 0. 
Therefore, 7, is the zero map. 


T(x, y) = x +74, 1) + ae T{1, ~ 1) 


\) 


= =F2'0,1,0,0) + =F" 4,0, 0,0) 


‘2 + TAA, +4 7,(1, —1) 
F144 01EZICL- : fed) 
= seed y). 

T(x, y) = 


T(x, y) 


= T,(1, --1) 


3 
oe 1,0,0) + ~ > ” 0,0,0.0) 


yt 7 y x -+- 
( 2 ’ yi. x, 0, 0). 


Problem Set 4.7 


1. Let U and V be vector spaces over the same field of scalars, and Ta 
map from U to V. Then prove that 7 is linear iff Tiau, + uy) 
= a7 (",) + T(u.) for all u,, uu, € U and scalar «. 

2. Which of the following maps are linear ? 

(a) T:V, — V, defined by 7(x) = (x, 2x, 3x) 

(b) 7: V, — V, defined by T(x) = (x, x?, x) 

(c) T: VS — V§ defined by 7(x, y) = (a + «, y, 0), a #0 
(d) T:V, —- Vz, defined by T(x, y) = (2x + 3y, 3x — 4y) 
(ec) 7: V, ~~» V, defined by T(x, y, 2) = (x* + xy, xy, yz) 
(f) 7: V, —> Vz defined by 7(x, y, z) = (x, y) 
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(g) T V§—V§ defined by T(x, y) = (y, x) 


(h) T V,-> Vz defined by 7(x, y, z) = (x + y + z, 0) 

Gi) T PX -> F defined by T(p) = p? 4- p 

(j) T YP > F defined by T(p)(x) = xptx) 4- p(1) 

(k) T: %’[0, 1] - V, defined by T(f) = (0), fC) 

(1) T XY -> F defined by T(p) = p(0) 
(m) T 9 -» £ defined by T(p)(x) = 2 4- 3x + 7x? p(x) 

(n) T: PY -> # defined by T(p)(x) = p(0) + xp'(0) +- *. p*(0) 
(0) T: P -» § defined by T(p) = p’ 


(Pp) T: Ga, 6) > F(a, 6) defined by T(f) = a,f +- af’ + ... 
+ anf'™, a;'s are fixed scalars 
(yy T: ‘7a, b)-> 6’(u, b) defined by Tf) = (3x? -+ 4)f" 
4- (7x + Df 4 (3x + Sf 
Determine whether there exists a linear map in the following cases, 
and where it does exist give the general formula. 
(a) T:V, --> VV, such that T(1, 2) -- (3, v) and 7(2, 1) = (1, 2) 
(b) 7:V, *+ V, such that 7(2, 1) - (2, 1) and 7(1, 2) == (4, 2) 
(c) T:V, »~V, such that 70, 1) = (3, 4), 73,1) = (Q, 2), and 
T(3, 2) = (5, 7) 
(d) T:V, »V, such that 7(0, 1.2) -= (3, 1,2) and TQ, I, 1) 
‘ 


(e) T:¥,-> Py suchthat TU -+ x) - 1 -l wx, T(2 ¢ x) 
- x -{ 3x*, and T(x*) = 0 
(f) T:9,-> F,such that T(1 } x) -= 1, T(x) = 3, and T(x’). 4 
(g) 7: VS + V§ such that 7,9 = (1 -- 7, 1). 
Determine a nonzero linear transformation 7: V, » V., which maps 
all the vectors on the line x == ¥ onto the origin. 
Determine a linear tranformation 7: F, - b,, which maps all the 
vectors on the line x + y == 0 onto themscives (T ~~ J). 
Let T:V¢->V¢ be defined by 7(%, j- 73,, % + iB.) == (a, a). 
Then prove or disprove that T is linear. 
Prove that a Jinear transformation on a |-dimensional vector space is 
nothing but multiplication by a fixed scalar. 
Prove Theorem 4.1.4. 
True or false ? 
(a) There exists a linear transformation T: V, -> V, such that 
7(0, 0) = (1, 0, 0, 0). 
(b) Scalar multiplication is the only linear transformation from V, 
to V,. 
(c) T: FA —» § defined as T(p(x)) = xp(x) is not a linear transfor- 
mation. 
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(d) T: V, + V, defined by 7(1, 1) = (I, 0, 0), 7(2, 1) = (0, 1, 0), 
7T(0, 1) == (0, 0, 1) is not linear. 

(e) Rotation cf coordinates in V, defined as (x, y) +> (x’, y’), 
where x’ = x cos0+ ysin 0, y’ = —x sin®+ y cos 0, isa 
linear transformation. 

(f) Let R+ be the vector space proved in Problem 2 of Problem Set 
3.1. Let 7: Vs — R* bea linear map. Then 7(0, 0, 0) = |. 

(g) Linear transformations cannot be defined from the real vector 
space C to the complex vector space C. 

(h) Let T: YU » V bea map such that 7(0u) + Ov. Then T is not 
linear. 


4.22 RANGE AND KERNEL OF A LINEAR MAP 


With reference to a linear map T: U — V, two sets are important. One 
is the range of 7, denoted by A(T) and already defined (cf Definition 
1.4.4) for any function 7 as the set of all T-images. The other is M(T), 
the kernel of 7, defined as follows. 


4.2.1 Definition Let 7: U +-V bea linear map. The kernel (null space) 
of T is the set 
N(T) = we U | T(u) = 0,4. 
[t is also denoted as kerT. 

In other words, M(7T) is the set of all those elements in U that are 
mapped by 7 into the zero of V. Note that this is nothing but the 
7T-pre-image of Ov (cf Defimition 1.4.2). 

As illustration, ict us find R(7) and NM(7) for each of the linear trans- 
formations T defined in Examples 4.1, 4.2, and 4.4-4.8. 


Example 4.11 \1n Example 4.1 we have T: V,; -+ V, defined by T(x,, x,, x3) 
= (X1, Xe, 0). 

Here R(T) is the set of all elements of the fourm (x,, x,, 0), which is 
nothing but the x,x,-plane in ’,. This also says that 7 is not onto 
(cf Definition 1.4.5). 

To determine N(T), the kernel of 7, we want all those vectors 
(X1, X25 X3) for which 7(x,, X,, X,) = 0. This means (x,, x,, 0) = (0, 0, 0). 
So x, = x, = 0. In fact, any element of the form (0, 0, .x,) would be 
mapped by 7 into (0, 0,0). No other element would be so mapped. 
Therefore, N(T) is the set of all elements of the form (0, 0, x3), which is 
nothing but the x,-axis in V3. 


Example 412 In Example 4.2 17: V, — Vg is defined by 7(x,, x3, X3) = 
(xX, — Xg, Xy + X4). 

In this case R(T) consists of vectors of the form (x, — x3, X, + 5). We 
want to determine the vectors of V, that are of this form. For this, take 
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a vector (a, 5) in V, and solve the equation 

(x1 — Xg, X, + X5) = (a, db). 
This means x, — x, = aand x, + x, = b. Solving these, we get 

Xy =X, —a,x3=b—-x,. 
Hence, 7(x,, x, — a,b — x,) = (a,b). This shows that every vector 
(a, 6) of V, is in R(T). In other words, R(T) = Vz. So this is an onto 
map. 

To determine the kernel, we solve the equation 7(x,, x2, x;) = (x, — 
Xe, X, 4- Xs) = (0, 0). This gives x, =: v2 = -- x5, i.e. all vectors of the 
form (x,, X;, —X,) will be mapped into zero. So 

NT) = {2,(1, 1, —1) | x, any scalar} = [(1, 1, —1)]. 
This is the subspace of V, generated by (1, 1, -1). 
Example 4.13 For the zero map (see Example 4.4) the range is '0,} and 
the kernel is U. This is clearly not 2n onto map. 


Example 4.14 For the identity map Jy (see Example 4.5) the kernel is 
{0,,}. The range is U, so the map is onto. 


Example 4.15 In Example 4.6 T: Vz-+V,-is defined by T(x, x.) 
= (x,,—%,). Here R(T) -= V, and N(T) = ((0, 0)}. This is an onto map. 
Example 4.16 Yn Example 4.7 D: (77a, b) > % (gq, bY is defined by 
D(f) =f’. In this case R(D) -= '/ (a,b), since every continuous function 
g& on (a, b) possesses an antiderivative and hence D is an onto map. 
N(D) is the set of all constant functions in ‘4, (a, 5). 


Example 4.17 In Example 4.8 J: O(a b)--R is detined by (Sf) 


= f° f(x)dx. Here the range is the whole of R, since every real number can 
be obtained as the algebraic area under some curve » = f(x) from a to 6. 
Therefore, it is an onto map. The kernel is the set of all those functions 
‘f for which the area under the curve y = f(x) from @ to b is zero. Jt is 
difficult to say anything more than this about the kernel. 

We shall now check whether the linear transformations discussed in 
Examples 4.11 to 4.17 are one-one (cf 1.4.7 for the definition of one-one). 

in Example 4.11 M(T) is the x-axis. So all points on the x,-axis go 
into (0, 0,0). So this map is not one-one. 

In Example 4.12 M(T)={[(!,1, —D]. So, many poigts go into 
(0, 0,0). This again means TF ts not one-one. 

In Example 4.13 M(7) = U. So the zero map is not one-one, because 
all elements go into the zero of V. 

In Example 4.14 the identity map 1s one-one, because,if x # y, then 
certainly I(x) + I(y). It may be noted that N(J) is the zero subspace of 


116 / LINEAR TRANSFORMATIONS 


In Example 4.15 the linear map T is one-one, because if (X41, X3) 
* (Vi. Ye), then (x;, — x3) is also not equal to (y,, —y2). Observe that in 
this case also N(T) is the zero subspace of F,. 

In Example 4.16, since different functions (say those that differ by 
a constant) have the same derivative, the map Dis not one one. Observe 
that N(T) is a nontrivial subspace in this case. In Example 4.17 the linear 
map T is not one-one. (Why 7) 

Summarising these observations, it appeavs that 7 is one-one when 
N(T) is the zero subspace and conversely. This is, in fact, true as a gene- 
ral statement, as is borne out by the following theorem which gives, in ad- 
dition, more information about R(T) and N(T) 

4.2.2 Theorem Ler T: U >V bea linear map. Then 
(a) R(T) is a subspace of V 
(b) M(T) is a subspace of U. 
(c) T is one-one iff N(T) is the zero subspace, {Qy}, uf U. 
(d) Uf (ty, ty, .... Un] = U, then R(T) = [T(u,), T(us), .. , T(un)I. 
(e) If U is fimte-dimensional, then don R(T) < dim U. 

Proof: (a) Let »,%, €E R(T). Then there exist vectors u,,u, in U 

such that 7(u,) = vy, and 7(u,) = v,.. So 

vy + v, = T(u,) + Tu,) -= Tu, + u,), 
since 7 is linear. But wu, + wu, € U, since U is a vector space. Hence, 
v, + v, is the image of an element of U. Suv, +», € R(T). In the same 
way, 2¥, = a7(u,) = T(xu,), since Tis linear. But 24, € U, because U is 
a vector space. Hence, zv, € R(T). Thus, R(T) is a subspace of V. 

(b) Let u,,u, E& MT). Then 7(u,) = Ov and 7(u,) — Or, because this 

is precisely the meaning of their being in N(T). Now 
T(u, + u,) = T(u,) + T(u,), since 7 is linear 
= 0,-' 0, =0,, 
which shows that u, 1- 4 € N(T). Similarly, for all scalars 2, we have 
T(xu,) == «T(u,), since T is linear 
= «0, = 0, (Theorem 3.1.7) 
which shows that vu, € N(T). Thus, M(T) is a subspace of U. 

(c) Suppose 7 1s one-one. Then 7(u) = 7(v) implies u=v. If 
uEG NT), then T(u) = Oy = T(Ov). Therefore, u=O0y. This means no 
nonzero vector u of U can belong to N(T). Since Ov in any case belongs to 
N(T) (why ?), it follows that N(7) contains only Ov and nothing else. 
Hence, N(7T) is the zero subspace of U. ; 

Conversely, suppose N(7) = {Ov}. Then, to prove that 7 is one-one, 
we have to prove that 7(u) = 7(v) implies u =v. Suppose T(u) = 7\(y). 


Then 
T(u — v) = Ti) — T(v) = Oy. 
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Sou—v€E NT) = {0u}. Sou — v = 0u, ie. u =v. This proves that T 
is one-one, 

(d) Let [u,, ug, ..., u,] = U. Then each vector u can be expressed as 
a linear combination of vectors , Us, ...,%,. The vectors T(u,), 
T(t), ...» T(un) are in R(T). So, obviously, [T(u,), T(ug),.... T(un)] C R(T). 
Let v € R(T). Then there exists a vector u EG U such that 7T(u) = v. Since 
uG U = [u, uo, ..., u,], we have 

U == Oly -|- Alle +... + Only . 
Therefore, vy == T(u) = Ta, + oatlg + ... + ant,) 
= 4,7(U;) + aT (ue) + ... + anT (un) . 
Sov € [7(u,), .... T(u,)]. This proves that 
R(T) = [T(u,), T(u,), .... T(un)} - 
(e) The proof is left to the reader. Jj 
We shall conclude this article with a definition. 


4.2.3 Definition Let 7: U-+V bea linear map. Then 
(a) If R(T) is finite-dimensional, the dimension of R(T) is called the 
rank of T and is denoted by r(T). 
(b) If M(T) is finite-dimensional, the dimension of N(T) is called the 
nullity of T and is denoted by x(T). 
We shall study these concepts at length in § 4.3. 


Problem Set 4.2 


1. Determine the range of the following linear transformations. Also 
find the rank of 7, where it exists. 
(a) T: V, —~ V, defined by 7(x,, x2) = (x, + 2, 1) 
(b) T: Vz — V; defined by T(x,, x.) == (X,, X1 + Xo, X2) 
(c) T: Vs — Vy defined by 7(x,, X2, X3) = (4%, + X2 + Xs; 
X, — 4X2, Xq) 
(d) 7: V,—» Vs, defined by 7(x,, 2, Xs) = (%;, Xa, Xe) 
(ec) T: Vz —> Vy defined by 7(x,, Xs, Xs, Xe) = (X1 — Xq, Xp + Xp 
Xs — X4) 
(f) T: Vy» Vz defined by T(x, Xg, Xs) = (41, X1 + gq, X + Xe 
+ Xs, Xs) 
(g) T: Ve — V, defined by 7(x,, Xa, Xs, Xq) = (3X, + 2Xq, X1 — Xqy 
$X1 — Xa, X9) 
(h) T: 9 — F defined by 7(pMx) = xp(x) : 
(i) T: P — F defined by 7(p\(x) = xp'(x) 
(j) T: f > § defined by 7(p)(x) = p(x) — 2p(x) 
(k) T: E’\0, 1) +¢’(O, 1) defined by 7(f)ix) = f(x) sin x 
(I) T: MO, 1) > FY ©, 1) defined by T(S(x) = S'(xe*. 
2. Determine the kernel of the linear transformations of Problem !> 
(a)-(l). Also find the nullity of 7, where it exists. 
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3. 


Let 7: V ->W be alinear map and U asubspace of V. Define 
T(U) = {wE W|w= Tu) for some ue U}. Then prove that 
T(U) is a subspace of W. 
Let 7: VW be a linear map and W, a subspace of W. Then 
prove that the set {v € V | T(v) € W,} is a subspace of V. 
Let 011, 125 ---) Sins Sars -2+ Lamy voey Xi +++ Zpn De any pn fixed 
scalars. Let T: V, — V, be a linear map defined by 
T(€4) == (Kyry ary 0-5 Sys), F = 1,2, ..., 0. 
Then prove that 
(a) TJ is not one-one if p < n 
(b) TJ is onto when p = mand (0,4, ..., &p1), (Xr25 »0+y Xpa), veep (Hyp, 
weey Upp) are LI. 
Find a linear transformation 7: V, -> V, such that the set of all 
vectors (%,, X2, X3) satisfying the equation 4x, — 3x, + x, = 0 is the 
kernel of T. 
Find a linear transformation 7: V,—> V, such that the set of all 
vectors (x, Xz, x3) satisfying the equation 4x, — 3x, -+ x, =0 is 
the range of 7. 
Pick out the maps in Problem | that are 
(a) one-one (b) onto (c) one-one and onto. 
True or false ? 
(a) Every constant map from one vector space to another is both 
one-one and onto. 
(b) A linear transformation T:V,—V, defined as T(I, !) 
= (1, 0, 0, 0) and 7(1, 2) = (2, 0, 0, 0) is one-one. 
(c) Every linear transformation from V, to itself is onto. 
(d) No linear transformation from V, to V, is onto. 
(e) There exist one-one linear transformations from V, to V2. 
(f) If 7: U — V is a linear transformation and v, € V, then the 
T-pre-image of vg is a subspace of U. 


4.3 RANK AND NULLITY 


A careful scrutiny of Table 4.1 shows that the image of a linearly 
independent set by a linear map need not be LI. The following theorem 
throws light on this situation. Essentially, it says that a one-one linear 
map will preserve linear independence, whereas under any linear map the 
set of pre-images of a linearly independent set of vectors is LI. 


4.3.1 Theorem Let T:U — V bea linear map. Then 


(a) If T is one-one and u,, %, ..., Uy, are linearly independent vectors 
of U, then T(u,), Tits), ...» T(un) are LI. 
(b) If v4, Ve, ...) ¥_ @re linearly independent vectors of R(T) and 


4.3 RANK AND NULLITY / 119 


Uy, Ugs ...y My Gre vectors of U such that T(u,) = 4, T(ug) = Vo, ..+5 
T(Un) = Yn, then u,, tg, ...) Uy OFe LI. 


Proof: (a) Let T be one-one and u,, ug, ...,U, be linearly indepen- 
dent vectors in U. To prove that Z(u,), T(u,),..., 7(un) are Li, we 
assume 

7 (uy) + XT (ug) + ... + OnT(Un) = 0 
or T(G,U, + Xgllg + ... + Oat,) = 0, 
since 7 is linear. So a,u, + %,%, + ... +: &.M, = 0, since JT is one-one. 
But u,, uz, ..., UW, ares. Soa, = 0 = a, = ... = ay, 
Thus, «,7(u,) + a7 (u,) +... + %,7(Uun) = 0 implies that each a, is 
zero. Hence, T(u,), T(uz), ..., T(un) are LI. 
(b) Let u,, us, ..., Un ANd V,, Ve, ...) Vn be as stated in Theorem 4.3.1. 
To prove that u,, uy, ..., 4, are LI, suppose 
Oy Ale + ... + onl, = O. 
Since 7 is linear, we have 
Oy = T(0v) = T (au; + Agly +... + Onn) 


or ,7(H,) + aT (ug) +... + %nT (Un) = Ov 
or AV, + Ove + ... + OY, = Ov. 
But v,, Vg, ---» Ve, are LI. Therefore, a, = 0 = a, = ... = &,. 


Thus, «4, + aM, + ... + &nu%, = 0 implies that «4, = 0—a4, =... 
= a. Hence, u,, ta, ..., Un are LI. §j 
Example 4.18 Prove that the linear map 7: V, ~ V, defined by T(e,) 
= @, — @,, T(€,) = 2€, + €3, T(e3) = €, + eg + ey is neither one-one nor 
onto. 
Since [e,, @,, €,] = V3, by Theorem 4.2.2 (d), 
R(T) = [T(e;), Tes), T(es)] = [e1 — 2, 2€g + ea, 1 + Ca + Cs] 
= [e, — 2, 2e, + ey] , 
because e, + e, + é, is a linear combination of e, — ée, and 2e, + éy. 
Now we see that e,-- e, and 2e, +e, are LI. So dim RT) = 2. 
Therefore, R(T) is a proper subset of V3. Hence, 7 is not onto. 
To prove that T is not one-one, we check N(T). N(T) consists of 
those vectors (x,, X2, X3) in V, for which 
T(x, Xe, X3) = 0 
or T(x,€,; + X2€, + X33) = 0 
or X1T(€:) + XsT(e,) + x7(e,) = 0, 
because T is linear. Thus, 
(x, + Xs, —X%, + 2xX_ + Xg, Xs + Xs) = (0, 0,0), 
ie. X, + X, = 0, x, + x, = 0, and —x, + 2x, + x, = 0. ‘Solving these, 
we get x, = X, = —X;3. Therefore, 
N(T) = {(x,, X1 —*;) | x, an arbitrary scalar} = [(1, 1, —1)] . 
Hence, by Theorem 4.2.2, T is not one-one. 
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In Example 4.18 the linearly independent vectors @,, @g, and ¢, span the 
domain space V,, but their images ¢, — &, 2€, + 3. and €, + €, + és are 
LD and dim R(7) = 2. 

Thus, we find that the effect of the linear map 7 on U = JV, is to 
shrink V, to a 2-dimensional subspace R(T) of V = V;. What happens 
to the remaining ‘one’ dimension ? 

Observe, in this case, that the kernel of T is [(1, 1, —1)] and so 
dim N(T) = 1. Thus, it appears that in this example 

dim R(T) + dim M(T) = dim FV, . 

This is not an accident. A general result of the same kind is true for 
all linear maps whose domain space is finite-dimensional. We shall now 
record this as a major theorem. 


4.3.2 Theorem (Rank-Nullity Theorem) Let T: U > V be a linear map 
and U a finite-dimensional vector space. Then 
dim R(T) + dim N(T) = dimU. (1) 

In other words, 

r(T) + vA(T) = dimU (2) 
or rank +- nullity = dimension of the domain space. 

Proof: N(T) is a subspace of a finite-dimensional vector space U. 
Therefore, N(T) is itself a finite-dimensional vector space. Let dim 
N(T) = n(T) = nand dim U = p(p gn). Let B= {u,, u, ..., Un} be a 
basis for N(T). Since u, © N(T), T(u,) = 0 for each i = 1,2,...,”. B 
is Lt in N(T) and therefore in U. Extend this linearly independent set of 
U toa basis for U. Let B, = {m, ug, ..., Uns Unt, ..-» Up} be a basis for 
U. 

Consider the set 
A = {T (Unt), T(nte), .--» T(uy)} . 
We shall now prove that A is a basis for R(T). Observe that, if this is 
proved, the proof of the theorem is over; for, this means 
dim R(T) = p — n= dim U — dim N(T), 
which is the same as Equation (1). 
It is therefore enough to prove 
(i) [4] = R(T), and 
(ii) A is LI. 
To prove (i) we proceed as follows: Since [B,] = U, it follows from 
Theorem 4.2.2 (d) that R(T) = [T(u,), T(ug), .--s Tn)» T(unsr)s «0+» T(Uy)]. 
But 7(u,) = Ofori = 1, 2,...,”. Hence, 
R(T) = [T(tnsr)» TUnsa)s ---5 T(tty)] - 
To prove (ii), consider 
Ons] (Unsy) + ... + tpl (uy) = 0. (3) 
Using the fact that 7 is linear, we get 
T(ntstar + .003 + Spy) = 0, 
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which means that tytn, + ... + ayy © N(T). Therefore, Onini 
+ ... + &gMy iS a unique linear combination of the basis B for N(T). 
Thus, 


Cnelnsy +... + OM, = Bu, +... + Balla, 


ie. Bu, +. eee +- BUn = hot Uyn+y «ee. Kylln = 0 ® 
B, being a basis for U is Li. Therefore, 
B= 8 =... = 8, = oy, =... = a, = 0. 
Thus, Equation (3) implies «,,, = ... = «, = 0. Hence, Ais L. § 


Example 4.19 Let T:V,->V, be a linear map defined by 7(e,) 
== (1, 1, 1), T(e,) = (1, —1, 1), T(e,) = (1, 0, 0), T(e,) = (1, 0, 1). Then 
verify that r(7) + n(7) = dim U (=V,) = 4. 

We know that R(T) = [(1, 1, 1), (1, --1, 1), (1, 0, 0), (1, 0, 1]. 
(1, 1,1), d, —1, 1), (1, 0, 0), and (1, 0, 1) are LD, because a set of four 
vectors of V, (dim V, = 3) is always LD. We find that 

(1,0, 1) = 41,1, 1) + 31, —1, 1) + 0@1, 0, 0). 
Hence, we can discard the vector (1, 0, 1), so that 
R(T) = [(1, 1, 1), (1, —1, 1), (1, ©, 0)) . 
To check whether (1, 1, 1), (1, —1, 1), and (1, 0, 0) are L!1, we suppose 
a(I, 1,1) + a,(I, =; 1) + x3(1, 0, 0) == 0 ~ (0, 0, 0) 

or (a, + %, 1 As, hy -— Hy, Hy 1° Oy) = (0, C, 0) : 
Solving this, we get «, = 0 = «, = a3. Hence, (1, 1, 1), (1, —1, 1), and 
(1, 0, 0) are LI and dim R(7) = r(7) = 3. 

Now to find M(7), we suppose that J(u) = 0 = (0, 0, 0). If 

U == (X41, Xg, Xgy Xq) = XyCy + Xgeg + Xge3 + yey, 

then T(X1, Xo, Xap Xq) = T(X yey 1 X22 + yey + eq) = (0, O, 0) 
or (xX, + X_ + Xy NXg, Xp — Xqy Xy +X, + X,) = (0,0, 0). 
Solving this, we get x, = x, = —x,/2,x,; = 0. So M(T) contains the 
vectors of the form (x,, x,, 0, —2x,), 1.e. N(T) = [(1, 1, 0,-—2)]. So 
n(T) = dim M(T) = 1. Hence, r(7) + n(T) = 3+1= 4, and the 
theorem is verified. 


Problem Set 4.3 


1. Let U be‘a vector space of dimension nm and 7: U - V be a linear 
and onto map. Then prove that 7 is one-one iff dim V = n. 


2. If 7: U— V is a linear map, where U is finite-dimensional, prove 
that 
(a) n(T) < dim U ‘ 
(b) r(T) < min (dim U, dim V). 
3. Let Z be a subspace of a finite-dimensional vector space U, and V a 


finite-dimensional vector space. Then prove that Z will be the 
kernel of a linear map 7: U > V iff dim Z p dim U — dim JV. 


Gam: 
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4. Prove Theorem 43.2 by the following method: Assume a basis 
{V5 Vay ---> Ye} for R(T) and u,, ty, ..., Ue in U such that 7(u,) = ¥, 
i= 1,2,...,7. Assume a basis {W,, Ws, ..., Wa} for M(Z). Then 
prove that {u,, ..., Ur, Wy)...» Wa} is a basis for U. 

5. True or false ? 

(a) No linear transformation from V, to V, car be one-one. 

(b) If 7: V, — V, is linear and one-one, then it is onto. 

(c) Let T: V, — V, bea linear map. Then R(T) can be a 4-dimen- 
sional subspace of V,. 

(d) Let 7: U + V be a linear map (U and V are finite-dimen- 
sional vector spaces). If T is one-one, then dim U < dim V. 

(ce) Polynomial functions p of degree less than or equal to 3 such 


that fp p(x)dx = 0 form a 3-dimensional subspace of 93. 


4.4 INVERSE OF A LINEAR TRANSFORMATION 


Linear transformations that are both one-one and onto play an 
important role. We give them a special name in the following definition. 
4.4.1 Definition A linear map JT: U - V is said to be nonsingular if it is 

one-one and onto. Such a map is also called an isomorphism. 

We know that any function has an inverse iff it is one-one and onto 
(cf Definition 1.7.8). Hence, we have the following fact. 

4.4.2 Fact A linear transformation is nonsingular iff it has an inverse. 

Let us illustrate this by the following examples. 

Example 4.20 Consider the map 7: ,-—>V, defined by T(%, + «,x 
+ ax") = (a, %, %). Clearly, T is a linear map (check !). This is 
onto, because given a vector (§,, 3,, 3) in V; we can get a polynomial 
B, + Byx + B,x* of which (6,, B,, Bs) is the 7-image. 

Further, 7 is one-one, because if B, = 0 = B, = §,, then the poly- 
nomial 8, + B,x + fx" also reduces to the zero polynomial of f,. Thus, 
T is an isomorphism. It is easily seen that JT : V, > 9, is defined as 

T~'(oty, gy tg) = Gy + OX + yx? 
Example 4.21 In Example 4.15 we have 7: V, -> V, defined by 7(x,, %3) 
== (x,, —x,). We have already seen that T is one-one and onto. 

To calculate 7~*(y,, y,), we have to find the element that maps into 
(yy Ys) by T. The answer is (y,, —y,), because 

Ts —Ya) = On — (Ya) = Ors Wa) - 

Thus, T-' : V, -> V; is defined by T~ (y1, Ye) = (Yas —Ys)- 

Example 4.22 We have already seen that the identity map Jy: U + U 
defined by Ju(u) = u for all wu € U is one-one and onto. So the inverse 
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of I, i.e. Jj?» exists as a map from U to U. Obviously, I5*(u) = # for 
allu @ U. Thus, J5? = lv. 


. In Examples 4.20-4.22 we can check that 7~ is linear. In fact, this is 
in general true as proved in the following theorem. 


4.4.3 Theorem Let T:U-—>V be a nonsingular linear map. Then 
T-1:; V - U isa linear, one-one, and onto map. 


Proof: To prove the linearity of T, let vy,¥,E V. Let 
T—(v,) = u, and T~(v,) = u,. Since T is one-one and onto, u, and t%, 
exist uniquely. Thus, v, = 7(w,) and v, = T(#,). So 

v, + vg = T(t) + Tl) = Th + 42), 
since 7 is linear. Therefore, 
T (vy, +) = 4 + = T-"(y,) + T*(vg) . 

Again, av, = «7(u,) = T(au,). So 

T—(xv,) = au, = aT~*(y,). 

Hence, 77 1s linear. 

T-) is onto decause, if ue U, then 7(u) = v belongs to V, and 
T(v) = u. : 

The rest of the proof is left to the reader. § 

The linear map 7: V, — V;, defined in Example 4.18, does not have 
an inverse, because it is neither one-one nor onto. 

A linear transformation 7 : U — V has an inverse, if the following two 
properties hold : 

(i) ZT is one-one. 

(ii) TJ is onto. 

If one or both of the properties fail to exist, then 7~? does not exist. 

In order to check whether 7 is one-one, we have to find N(7). If N(T) 
is the zero subspace, then 7 is one-one, otherwise it is not. The second 
property, namely, T is onto, holds if R(T) = V. This involves the 
determination of R(7), the range space of 7. 

4.4.4 Remark Instead of calculating the kernel, if we can somehow find 
(perhaps by guesswork) more than one vector in U, which maps into 
the same vector in V by 7, then this would be enough to prove that 
T-) does not exist. In the case of Example 4.18 7(1, 1, 0) 
== (1, 1, 1) and 7(2, 2, —1) = (1, 1, 1). 

Just from this we could have concluded that 7 does not have an 
inverse. However, the method that involves finding the kernei is re- 
commended to the reader, since it is applicable in most cases. 

We shall now consider two more examples in which T™ does not exist, 
because in one case T is one-one but not onto, and in the other case T is 
onto but not one-one. 
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Example 4.23 Let U be the set of all infinite sequences {x,, X9, ...» Xn» »--} 
of real numbers. Define the operations of addition and scalar multipli- 
cation coordinatewise as in V,, i.e. if 


X = {x,, Xq, .-., Xn, os} 
and Y= AVS Ven ces Vas eds 
then x+y= {x; + Vis Xo + Ya, -2 Xn + Ya; any 
and OX = {0X}, Xo, 00.5 BXny ...} 


The set U with these two operaticns becomes a real vector space (check !). 
Note that the sequence {0, 0, ...40, ...} is the zero of U and {—x,, 
—Xg, ..+) —Xny ...} iS the negative of x. 

Let 7: U — U be defined by 

T(x) = T({X1, X25 00-5 Xny ++ }) 
il Kay Neu cite Rasa) 2 
It is easy to check that 7 is linear. Here R(T) = U. For, take the 
sequence {y,, Yo, ..-» Yn» ---$. Its pre-image by 7 can be any sequence of 
the form {2Z, Y1, Voy ---» Yn» --.$s Where z can be areal number. In parti- 
cular, z can be zero. Hence, 7 1s onto. 

But 7 is not one-one, because all the sequences {z, y,, Vo, ...; Yns ---} 
map into {¥1, Ye, -.-» Ya, ---}- Further, NM(7) is the set of all sequences of 
the form {z, 0, 0, ..., 0, ...}. 

Thus, though 7 1s onto it does not have an inverse, since T is not 
one-one. 


Example 4.24 Let U be the vector space of Example 4.23. And let 
T:U — U be defined by 


TX) Xes v00y Xny «-¥) == (0, Xyy Ags 000g Any «ee} > 
Obviously, T is linear (check !). Now T is one-one, for N(T) is the set of 
all sequences of the form {0, 0,0, ...,0,...}. There is only one such 
sequence, namely, the zero element of the space U. So N(T) = {Ov}. 
But T is not onto, because the element {1, 1, 1, ..., 1, ...} has no pre- 
image in U. So R(T) # U. Hence, Tr does not have an inverse. 


In Examples 4.23 and 4.24 we produced situations where just one of the 
two conditions, namely, (i) T is one-one, (ii) T is onto, holds and the other 
does not hold. Further, note that in these examples the space U involved 
is not finite-dimensional. (Why?) When U is finite-dimensional, we may 
not be able to produce such an example, because of the following 
theorem, which essentially says that if 7: U — V is a linear map and 
dim U = dim V, then the two conditions (i) 7 is one-one and (ii) 7 is onto 
are implications of each other. 


4.4.5 Theorem [f U and V are finite-dimensional vector spaces of the same 
dimension, then a linear map T : U -> V is one-one iff it is onto. 
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Proof: T is one-one @ N(T) = {0} (Theorem 4.2.2) 
#n(T) = 0 (Definition 4.2.3) 
@ r(T) = dim U=dimV (Theorem 4.3.2) 
@ R(T) =V (Theorem 3.6.13) 


« T is onto. | 
Now we shall take up an example where the inverse exists and we 
proceed to calculate it. Recall that a linear map is completely determined 
as soon as its values on the elements of a basis are specified. Therefore, 
in order to determine the linear map 7, it is enough to determine the 
values of 7~! on the elements of a basis. 


Example 4.25 Prove that the linear map T: V, -> V, defined by T(e,) 
= @, + €,, T(e,) = &, + e3, Tes) = €: + eg + es is nonsingular, and 
find its inverse. 
First, let us find the value of 7 at a general element u = (x,, X,, Xs) : 
T(X1, X25 Xs) = T( xe) + Xgl— + X33) 
= (x + X3, X1 + X_ + Xy, Xy + Xq). 
If T(x, X,, X3) = 0, then 
Hy +%,=0, 4 +x, +%,= 0, xX + x = 0. 
Solving these, we get x, = 0 = x, = x;. So N(T) = {Ov,} and hence T 
is one-one. It follows from Theorem 4.4.5 that 7 is also onto. Hence, 7 
is nonsingular and 7~' exists. 


Now we shall give:two methods to find the inverse, 7~’, which is also a 
linear, one-one, and onto map from V, to V3, 
Method | We have T(e,) = ¢; + @s, T(e@s) = eg + 3, T(es) = e, + e- 
+ és. Therefore, 
e, = T7*(e, + e,) = T(e;) + T~*(e,) 
C9 T(e, + @3) = T*(e,) + Tes) 
e=T(e,+ e+e) — 
T~\(e,;) + T(e,) + Tey) 
because JT"! is linear, one-one, and onto. Solving these three equations 
for T-(e,). T~"(e,), and /~*(e5), we get 
T*(e;) = és —-& = (0, —l, 1) 
T~(e,) = €; + & — es = (1,1, —1) 
T (es) = €, — ey = (~—1, 0,1). 
Now we extend 7 linearly and obtain 
T~(X1, X3, Xg) = T*(%1€1 + Xg€q + Xges) 
= X,T~(e,) + XT ~*(e4) + x3T-\(e) 
se (Xy — Xqy Xy — Hi, X1 — Hq + Hq). 
Method 2 Let T(x, Xe Xs) aa (Yas J 89 J 3) Then 
TU 1 Ve Ys) = (x1, Xa, Xs) 
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TO €1 + i + Vela) = (Xy es x5) 

or ViT(e:) + WeT(6n) + V3T (ly) = (1, Xav Xs) 

or On, + ¥s'€1 + Or +s + Yada + (Ya + Val€y = (X1, X2, X5) 
or (V1 + Var V1 + Va + Pas Ve + Ys) = (Xt, Xs Xq) - 
This gives y, + Vs = Xs. Vi + 2 + Vg = Xe, and Vy + Vy = Xz. 
these, we get y, == X; — Xo, Vg = Xq — Xz, aNd Vy == Xy — Xy + Ay. 


T(x, Xg, X3) = (Xe — Xa, Xq — Ay Hy — Xe + Xs). 


or 


Solving 
So 


Problem Set 4.4 


1. Let R, S, and T be three linear maps from V, to V, defined by the 
values in Table 4.2. Determine which of them are nonsingular and 


in each such case find the inverse. 


TABLE 4.2 
Value at -> 
i she eG eC; @, C; 
Linear maps 
R ey ; C3 Qe, = C5 + eC; -@; a 4e, 
S @, -- e. e, Ce, + e,- Tes, 
T €e:- @& +e, 3e, — Se, 32, — 2¢, 


ee oo ee —_ - ete ee ree ee re 


——_ Ce ae ed 


2. Show that each of the following maps is nonsingular and find its 
inverse : 
(a) T:V, » V, defined by 7(x,, x,) = (@,xX,, &,X,), where a, and 2, 
are both nonzero. : 
(b) 7: V, — V, defined by T(x,, X., X3) =- (%1, + Xy + Xg, Xg-} Xe, 
Ng). 
(c) Ti Yy-> YF, defined by Tro, + a,x |- ax") = (vg | &) 4 
(ay -| 2ay)x + (%q 4 ay + 2a,)x’, 
3. Let U be the subset {p © ¥ | p(0) = O} of ¥. Then rove that the 
derivative D is a nonsingular linear map from U to ¢Y, and the 


integral (4(p))(x) So p(x)dx is its inverse. 
4. Let 7: U »>V be a nonsingular linear transformation. 
that (7 ')"! ~ T. 
5. True or false ? ° 
(a) Fvery linear map from V, to V, has an inverse. 
(b) The inverse of a nonsingular linear map is nonsingular. 
(c) A nonsingular linear map transforms linearly independent sets 
into linearly independent sets. 


Then prove 
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(d) A nonsingular linear map transforms linearly dependent sets 
into linearly deperident sets. 

(e) Every translation of V, to V, has an inverse. 

(f) Every translation of V, to V, is an isomorphism. 


(g) Given two vectors m,u, € U, there exists an isomorphism 
T:U +U such that 7(u,) = w. 


4.5 CONSEQUENCES OF RANK-NULLITY THEOREM 


The results discussed in § 4.4 and certain allied facts are important for 
further discussions. We collect them together in the following theorem. 


4.5.4 Theorem Let T: U-> V be a linear map and dim U = dim V = p. 

Then the following statements are cquivalent : 

(a) TJ is nonsingular (an isomorphism), 

(b) Tis one-one. 

(c) JT transforms linearly independent subsets of U into linearly wnde- 

pendent subsets of V. 

(d) T transforms every basis for U- into a basis for V. 

(e) Tis onto. 

(f) r(T) = p. 

(g) a(T) = 0. 

(h)- 7! exists. 

Proof: (a) ~ (b) by Definition 4.4.1. 

(b) => (c) by Theorem 4.3.1(a). 

(co) » (d). Let 7 transform hoearly independent subscts of U into- 
linearly independent subsets of R(7'). Now, let {u,, tt, ..., Up} be a besis 
for U. Then T(u,), T(u,), .... Tv,) are Lt by hypothesis. But dim V- 

=p. So {7(u,), T(u;), .... T(uy)} is a basis for V by Theorem 3.6.7. 

(d) > (e). Let {u,, a, ..., u,} be a basis for U. Then, by hypothesis, 
{T(u,), T(u,), ..., T(u,)} is a basis for V. This means, by Theorem 4.2.2 (d), 
R(T) -- V. Hence, T is onto. 

(e) > (fy. Tisonto > R(T) = V » r(T) — p. 

(1) > (g) by the Rank-Nullity theorem. 

(g) > (h). 2(T) - O means M7) - {Ov}, ie. Tis one-one. So T is 
onto by Theorem 44.5. Hence, T”' exists. 

(h) => (a) by Fact 4.4.2. § % 

We shall conclude this article by exhibiting an important isomorphism 
of linear algebra. 


4.5.2 Definition "Two vector spaces U and V are said 1o be isomorphic if 
there exists’ an isomorphism from U to V. If U and FV are iso- 
morphic. then we write U = V. 
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4.5.3 Theorem rig real (complex) vector space of dimension p is iso. 
morphic to V, (VS). 


Proof: Let U be a real vector space of dimension p, B = {u,, 
Us, ---» Mp} an ordered basis for U, u an arbitrary element of U, and 
(%1, %qy .»+» &p) the coordinate vector of u relative to B. Consider the map 
T : U - V, defined by 

T(u) = (a1, Og, ..., Xp) . 
This map is-easily secn to be linear; for, if 
U == OU, + Ally + ... + Aylly 

and v = By, + Baty + ... + Botty, 
then utv= (a, + B, ey + (a, + B,)t, seas os (a, ss By), , 

Hence, the coordinate vector of w+ v relative to Bis («, + §,, 

Le + B., wsey hey + B,). So 

T(t + Vv) = (&) + Ba, & + Boy... %&» + By) . 
But T(u) + T(v) ae (a, Gay cany Oy) + (B,, B., cary By) ° 
Therefore, Tu + v) = Tu) + To). 
Similarly, T(au) = «7(u). 

Further, T is-one-one, because 7(u) = (,, %, ...,%)) = 0, means 
a,=QO=a,=..=4,, which implies uw = Ou, + Om +... + Ou, 
= Oy, ie. N(T) = {Oy}. Thus, by Theorem 4.5.1, T is an isomorphism. 
Hence, there exists an isomorphism from U to V, and consequently 
U = V,. The proof of the other part is left to the reader. Jj 
Example 4.26 In Example 4.20 we have seen that 7: ?, —> V, defined by 
T(% + %,x + a,x") = (a, «1, %) isan isomorphism. Thus, 7, = V3. 

Theorem 4.5.3 says that not only ¥, but also any real vector space of 
dimension 3 is isomorphic to V3. 


Problem Set 4.5 


1. Prove that ‘ = ’ is an equivalence relation. 
2. Let A be the subspace of V, defined by 
A = {(X4, Xp, Xa, Xq) | Xq = O}. 
Prove, by exhibiting an isomorphism, that A = V3. 
3. Let Bbe the re of 9, defined by 
= {p | p’(1) = 9, p(1) = 0}. 
Prove, by sien an isomorphism, that B = V4. 
4, Prove, by exhibiting an isomorphism, that A = B, where A and B 
are subspaces of Problems 2 and 3. 
5. True or false ? 
{a) The differential operator D : P?, — Pa_; has nullity zero. . 
(b) There exist two isomorphisms from #, to V. 
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(c) In V, all nontrivial subspaces are isomorphic. 
(d) Rotation in V, is an isomorphism. 


(e) Let 7: V + V (V is a finite-dimensional vector space) be a linear 
map. If R(T) 1 N(T) = {Oy}, then V = R(T) @ NT). 


4.6 THE SPACE £(U, V) 
SUM OF TWO LINEAR MAPS 


Let 7: VU >V and S: U — V be two linear transformations. Con- 
sider the map M: U — V defined by 
M(u) = S(u) + Tu) for allu € U. 
We shall prove that M is linear, that is, 
M(u, + uz) = M(u,) + M(uy) 
and M(au,) = aM(u,) , 
for all u,, u, € U and all scalars « . 
We have 
M(u, | te) = S(u, + u,) + T(u, + u,) (definition of M) 
= (S(u,) + S(us)) + (Miu) + T04)), 
because § and T are linear maps. On the other hand, 
M(u;) + M(ug) = (S(u:) + T(u,)) + (S(u.) + T(u)) 
(definition of M) 
= (S(u,) + S(u,)) + (T(u,) + T(u,)) 
by associativity and commutativity of addition in V. Thus, 
M(u, + ue) = M(u,) + M(ug) for all u,, u, € U. 
Again, M(au,) = S(au,) + T(au,) (definition of M) 
= a(S(u,)) + «(7(u,)) (S, 7 are linear) 
= a(S(u,) + T(u,)) 
by properties of scalar multiplication in V. Thus, M(au,) = aM(u,) for 
all u, © U and all scalars «. This proves that M 1s a linear map. 
The map M defined above is called the sum of S and T and is denoted 
by S+ 7. Thus, 
(S + T)\u) = M(u) = S(u) + Tu) foraliu Ee VG. (1) 
We have thus shown that the sum of two linear maps is linear. 


SCALAR MULTIPLE OF A LINEAR MAP 


Let S: U + V bea linear map and « a given scalar. Note that U and 
V are vector spaces over the same field of scalars, and « also belongs to 
the same field. Consider the map P: U — V defined by - 
P(u) = «(S(u)) for allu € UV. 
We shall prove that P is linear, 
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Let u,, 4, be two elements of U and A be a scalar. Then 


P(u, + ug) = a(S(u, + u,)) (definition of P) 
= a(S(u,) + S(ue)) (S is linear) 
= 0(S(u,)) + a(S(up)) (V is a vector space) 
= P(u,) + P{us) (definition of P). 

Again, 
Pu) = «(S(Au,)) (definition of P) . 

= aA(S(u,))) (S is linear) 
= A(a(S(u,))) (V is a vector space) 


= AP(u;)) ‘for each scalar A (definition of P). 
This proves that P is a linear map. 
The map P defined above is called the scalar multiple of S by « and is 
denoted by «S. Thus, 
(aS)(u) == Plu) = a(S(u)) forally € U. (2) 
Thus, the scalar multiple of a linear map is linear. 


Example 4.27 Let T: Vs; > V, and S:V,-—> V, be two linear maps 
defined by 
T(X1, Xg. Xy) = (X1 — Xe, Xe + Xs) 
and S(X1, Xye Xy) = (2X1, Xy — Xg)- 
Then (S + T): Vy — V, is given by 
(S 7 T\(X3,-%95 Xs) me S(x;, Xa, Xs) 2 T(x, Xe» Xz) 
== (Xy — Xg, Xq + X5) + (2%, X2 — X;) 
= (3x; — X, 2x,); 
and «aS : V, —> V, is given by 
(aS)(X1, X2, X3) == a(S(X,, X2, X5)) 
== O(X, — Xg, X_ + Xs) 
== (4X, — OX_q, ax, + aX). 
Example 4.28 Let T:V,;->V, and S:V,->V 3 be two linear maps 
defined by 
T(e,) = e; + eg, T(e,) = es, T(es) = e, — €3; 
and S(e,) = €3, Se.) = 2e, — €s, Sl(e,) = 0. 
Then S + T: V, — V, is given by 
(S + T)(e,) = S(e,) + Te) = e, + eg + C3 » 
(S + Ti(es) = S(e,) + Tleq) = 2e,, 
(S + T)(es) = S(es) + Tle) = e, — 63; 
and 27 : V, — V, is given by ; 
(27 )(e;) = 2(T(e,)) = 2e, + 2e;, 
(2T)(eq) = 2(T(e,)) = 20, , 
(27 )(es) = 2(T(e,)) = 2e, — 2e,. 
The set of ail linear transformations from U to V is denoted by L(U, V), 
We now have three different objects before us (see Figure 4,2), namely, 
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(1) the vector space U, 
(ii) the vector space V, and 
(ili) the set L(U,’ V), whose elements are linear maps 7: U — V. 
The sum of two linear maps and the scalar multiple of a linear map of 
the foregoing discussion give us the operations of addition and scalar 


multiplication in L(U,V). Our claim 1s that L(U, V) is a vector space for 
this addition and scalar multiplication. 


FIGURE 4.2 


Since the sum of two linear transformations is a linear transformation 
and the scalar multiple of a linear transformation is linear, we have only 
to check axiom (VS3). First note that L(U, V) is a commutative group 
for addition. The zero map 0:U->V, defined by O(u) = 0+ for all 
ue U, 1s in LU, V) (see Example 4 4) and plays the role of identity for 
addition in L(U, V). The map (—S):U-—V 1s defined by (—S)(uj 
= — (S(u)) for all wE U. It is easily seen that (-S) € L(U, V) and 
—S = (—1)S. 

Further, if S and 7 are two members of L(U, V) and «, B two scalars, 
then 

(i) a(S + T) = aS + af, 
(ii) (a + B)S = «S + BS, 

(iii) a(8S) = («8)S = BES), 

(iv) 1S = S. 

We shall leave it to the reader to verify these axioms. Once they are 
verified, we will have proved the following theorem: 


4.6.1 Theorem The set L(U, V) of all linear tran:formations from U toV 
together with the operations of addition and scalar multiplication 
defined in Statements (i) and (ii) is a vector space. 


4.6.2 Remark It should be noted that L(U, V) is a real vector space if 
both U and V are real vector spaces, and it is a complex vector. space 
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if both U and V are complex vector spaces. 


We shall prove in Chapter 5 that if U and V are finite-dimensional 
vector spaces, then dim L(U, V) = dim U x dim V. 


Problem Set 4.6 


1. Let the linear maps 7: V, - V, and S : V, - V, be defined by 
T(x, Xg) = (x, + X,, 9), 
S(%1, Xg) = (2X3, 3x, + 4x,). 
Determine the linear maps 
(a) 2S + 37 (b) 3S — 77. 
2. Let the lincar maps 7 : V, > V; and 3: V, > V, be defined by 
T(X, Xa, X3) = (2X, — 3Xg, 4X1, + 6X4, X5) 
S(e,) = &g — €3, S(es) = €;, Ses) = €; + eg + ey. 
Determine the linear maps 
(a) S+T (b) 3S — 2T (c) aS 
and find their values at (x,, X, X53). 
3. Let the linear maps R, S, and 7 be defined as in Problem |, § 4.4. 
Then find the linear maps 
(a) R+ 28 (b) 2R + ST (c) S—T 
(d) R+S+ 2T (ec) aR + BS + yT. 
4. Prove that the set of all lineag maps from V, to V, which map the 
vectors on the line x + y= onto the origin is a subspace of 
L(V, V2). 


5. Let U be a subspace of a vector space V. Then prove that the set of 
all lear transformations from V to V that vanish on U is a subspace 
of L(V, V). 
6. Let 7: V,—V, be a nonzero linear transformation. Then prove 
that L(V,, V;) = (71. 
7. Determine two linear transformations T and S of rank 4 from V, to 
V, such that 
(a) r(T + S) = 3 (b) r(T— S)=2 
(c) r(7 + 2S) = 1 (d) “(7T—S)=0. 
8. Prove Theorem 4.6.1. 
9. If S and T belong to L(U, U), then prove that So T € L(U, U). 
10. True or false ? 
(a) To prove «a(S + T) = «aS + aT, where S and T are linear maps 
from U to V, it is enough to prove that S + 7 is linear. 
(b) L(U, R) is a proper subset of F p(U). 
(c) If S, 7: U — V are linear, then S — T is linear. 
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(d) Fora linear map S, —S(u) = S(—u). 

(ec) vy E LIU, V). 

(f) Rank of (S + 7) = rank of S + rank of T. 
(g) Rank of (aS) = « rank of S. 


4.77 COMPOSITION OF LINEAR MAPS 


Let T: U > Vand S: V - W be two linear maps. We know that the 
composition S o 7; U -> W’ is defined by 
So T(u) = S(Mu)) for allue U (Definition 1.7.2). 


SoT T S 
Symbolically, U ——-> W = U->V—>W. 


This map is linear, because with the usual terminology 


So T(u, + uy) = S(T, + 4) (definition of composition) 
= §(7(u,) + T(ue)) (T is linear) 
= §(T(u,)) + S(T(u,)) (S 1s linear) 
== (SO T)(%) + (SoT)(u.) (definition of 
composition) 
for all u,, wu, € UV. 
Again, (So T)(au,) = S(T(au,)) (definition of composition) 
= $(«(T(u,))) (T is linear) 
= «(S(T(u;))) (S is linear) 
= a(§ o T)(u,) (definition of composition) 


for all u, © U and all scalars «. 
Thus, the composition of two linear maps is a linear map. 


Example 4.29 Let a linear map T: V, — V, be defined by 
T(e,) = (1, 1, 0, 0), Tle) = (1, —1, 1, 0), T(e,) = (0, —1, 1, 1), 
where {e,, ,, ¢s} is the standard basis for V3, and let a linear map 
S : V4 — V, be defined by 
S(f) = (1,9), Sf) = 1,1), SC) = 1, —-1, SCA) = (0, 1), 
where {/;,/2» fs» fa} is the standard basis for V,. Then the lineat map 
SoT:V, — Vz is obtained as follows (see Figure 4.3) : 
(So T\ez) = S(T(e)) = S(1, 1,0, 0) = S(/, + fa) 
= S(fi) + SCA) = (1, 0) + (1,1) = (2,1), 
(So T)(e,) = S(7(eq)) = S(1, —1, 1,0) = SCA —- A +h) 
= S(f) — S(f.) + S(Zs) 
(So Tes) = S(T(es)) = SO, —1,1,1) = (-f th +f) 
= —S( fy) + Ss) + S(f) 
= —(1,1) + (1, -1) + @,1) = 0, —1). 


134 / LINEAR TRANSFORMATIUNS 


We shall hereafter use ST for So T and call it the product of § and T, 
rather than the composition of S and T. 

We know that if ST is defined, then 7S need not be defined. Even if 
both are defined, they need not be cqual. Thus, the commutative law of 
the product is not in general satisfied. The other laws of multiplication 
are easily seen to hold. 


FiGure 4.3 


4.7.1 Theorem Let 7,, 7, be linear maps from U to V. Let S,, S, be 
linear maps from V to W. Let P be a linear map from W to Z, where 
U, V, W, and Z are vector spaces over the same field of scalars. Then 


(a) S(T, + 7T,) = S,T, + ST, . 

(b) (5S, + S,)7; = ST, + S,T, . 

(c) P(S,7T,) = (PS)T, . 

(d) (aS,)7, = «(S,7,) = S,(«7,), where « is a scalar. 

(ec) IyT, = 7, and T,ly = T, . 

Proof: (a) T, +7,:U—->Vand S,:V—>Warelinear. The pro- 
ducts S,(7, + 7,) and S,7T;, S,7, are defined. So both sides of (a) make 
sense. Now, if u is a vector of U, then 


(S\(T, + 7,))(u) = S(T, + 7T3)(u)) (definition of product) 
= S,(7,(u) + 7T(u)) (definition of addition 
in L(U, V)) 


= S,(T,(u)) + S,(7,(4)) — (S, is linear) 

= (S,7,)(u) + (S,;T)(4) ‘(definition of product) 

= (S,7, + S,7T3)(u) (definition of addition 
in L(U, V)). 


S\(7, + 7) = 5,7, + S,7,. 
The proofs of the remaining parts are left to the reader. §j 
Note specially the diagram for part (e) of Theorem 4.7.1 : 


Hence, 
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7; ly T, 
U—> V—-> V= U—-> V 
lu T, T, 
Poet Ve Pasey, 

Let 7: U-> V be a eta iia map, te T 15 linear, one-one, 
and onto. Then we know that T-': V -> U exists and is Jianear (Theorem 
4.4.3), Further, 7£ 1 = ly aiid TT -- Iu (ct $1.7). In fact, this 
characterises nonsingularity as shown in the following theorem 
4.7.2 Theorem A linear map T;U ~V is nonsingular iff there exists a 

linear map S:V + U such that TS = I, and ST = ly. 

In such a case § = T-1 and T = S-. 

Proof; Wet T be nonsingular. The existence of S, namely, 7-', 
follows from the observations made immediately before the theorem. 

Fd let S and T exist with the properties stated, ie. TS = ly 
and ST = 

Let u 7 NCI. Then 7(u) = 0 and consequently S(7(u)) = 0 But 
S(T(u)) = Ju(u) = u. Therefore, u = 0. So N(T) 1s the zero subspace 
of U. Hence, 7 is one-one. 

Now let v€ V. Then 7(S(v)) = (TS)\v) = (vy) = v Therefore, 
there exists an element u = S(v) in U such that 7(u) = v. Hence, 7 1s 
onto. Thus, 7 1s nonsingular. Therefore, T-! exists by Fact 4 4.2. 
Further, using Theorem 4.7.1, we get 


T= T-(Iy) = T-(TS) = (T"T)S = oS = S. 
Similarly, 7 = S.J] 
Finally, we prove the following interesting theorem. 
4.7.3 Theorem Let T: U + Vand S:V -»> W be two linear maps Then 
(a) If S and T are nonsingular, then ST is nonsingular and 
(ST)? = T-15-1, 
(b) Jf ST is one-one, then T is one-one. 
(c) If ST is onto, then S is onto. 
" (d) Uf ST is nonsingular, then T is one-one and S is onto. 
(e) If U,V, W are of the same finite dimension and ST is nonsingular, 
then both S and T are nonsingular. 
Proof: (a) Since S is nonsingular, S-' is defined and ss” = ly 
and SS = Ty. 
Since 7 is nonsingular, 7-' is defined and 7T-' = Jy and T-"T = ly. 
By virtue of (c) and (e) of Theorem 4.7.1, we have 
(STATS) = S(T(T-*S-?)) = S(TT-)S-) 
sx S(ipS-") = SS) os Ve 
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Similarly, 
(T-*S I(ST) = T-(S-(ST)) = T-((S“'S)T) 
= TIT) = TT = ly. 
Hence, by Theorem 4.7.2, ST is nonsingular and (ST)? = 7-"S-, 

(b) Let ue NT). Then T(u) = Oy. So S(T(u)) = Ow, ie. (STXu) 
= @,. But ST is one-one. Therefore, u = Oy, i.e. N(T) = {0,}. Thus, 
T is one-one. 

(c) Let w € W. Since ST is onto, there exists a vector u€ U such 
that (ST)(u) = w. Therefore, S(7(u)) = w. Hence, there exists a vector 
vy = T(u) € V such that S(v) = w. Thus, S is onto. 

The proofs of (d) and (e) are left to the reader. § 


Notations (a) The set of all linear operators on U is denoted by L(U). 
(b) If 7 is a linear transformation on U, then the composition 7T is also 
denoted by 7°. Similarly, 7* = T*-'T for any positive integer k. By 
convention, 7° = J. 


Problem Set 4.7 


1. Let 7: V,;— Vz be defined by 7(x,, X,, x3) = (x, + x2. + Xz, X;) 
end S : V, — V, be defined by S(x,, x.) —= (x2, x,;). Then determine 
ST. 

2. Let S and 7 be as in Problem 1, § 4.6. Determine 
(a) ST (b) TS’ (c) S* = (d) 7'°S. 

3. Let S and T be as in Problem 2, § 4.6. Determine 

(a) ST (b) TS (c) STS (d) TST. 

4. Let R,S,T be as in Problem 1,§ 4.4. Determine 
(a) ST (ob) RT (c) RST (4d) RS+T) CT 
(f) J*ST. Also verify that R(S + 7) = RS + RT. 

5. Determine two linear transformations S and T on V, such that S7' 
= 0 L(V) and 7S = Or,): 

6. Let S and 7 be two linear maps on U such that ST = TS. Then 
prove that 
(a) (SS+ 7) = S + 2ST) + TF 
(b) (S+ TY = S + nc ST + ... + nc,T. 
(Hint : Use induction.) 

7. Let V be a 1-dimensional vector space and S, T two linear maps on 
V. Then prove that ST = TS. 


8. Let 7 be a linear map on a |-dimensional vector space V. Then 
prove that 7? = «TJ for some fixed scalar «. 


9. Find the range, kernel, rank, and nullity of the following linear 


14. 
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maps, where R, S, 7 are as in Problem | of Problem Set 4.4: 

(a) RS (b) RT ~ (c) RST. 

Let T be a linear map on a finite-dimensional vector space V. Then 
prove that 

(a) R(T) ON NT) = {iff T’x = 0 > Tx = 0 

(b) If r(T*) = r(7T), then R(T) M N(T) = {0}. 


If a linear transformation T on V satisfics oe condition 7? + J = 7, 
then prove that 7-! exists. 


Let T be a linear map on Vy defined by 7(e,) = e, T(e.) = e,, 
T(es) = @,. Then prove that T? = T ', 

Let 7: U-> Vand S: V — W be two linear maps. Then prove that 
(a) If T is onto, then r(ST) = r(S) 

(b) If S is one-one, then r(ST) = r(T). 

A linear transformation T on a vector space V 1s said to be idempo- 


tent if T? = T. For example, the zero transformation and the 
identity transformation are idempotent. 


(a) Let S and T be two linear maps on V, defined as 
T(X;, Xe, X3} = (0, X—, X5) 
S(x1, Xz, Xy) — (¥,, 0, 0). 
Then prove that both S and 7 are idempotent. 
(b) If S, and S, are idempotent on a vector space V, then find the 
conditions under which S,S, and S, + S, are idempotent. 
(c) If S is idempotent on a vector space V, then J—S is alro 
idempotent on V. 
(d) Determine two idempotent transformations S and 7 on a vector 
space V such that ST = 7S = 0, but neither S = 0 nor 7 = 0. 
(ec) If J 1s an idempotent transformation on V, then prove that 
NT) = RU — T) and R(T) = NU — T). 


15. A linear transformation 7 on a vector space V is said to be nilpotent 


on V if 7" = 0 for some integer m > 1, and the smallest such integer 
‘n’ is called the degree of nilpotence of T. 
(a) Prove that the differential operator D is nilpotent on ?,. What 
is the degree of nilpotence of D? 
(b) Is D? + D nilpotent on 9,? If yes, find its degree of nilpo- 
tence. 
(c) Let T: Vi > V, be defined by 
T(X1, Xs, Xys Xq) = (0, X1, Xp» Xp) - 
Is T nilpotent ? 
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(d) Let 7: V, —> V, be defined by 
T(e,) = 0, T(e,) = €, T(es) = 2e, + 3ez. 
Is T nilpotent ? 


(e) If S and 7 are nilpotent transformations on a vector space V 
and ST = 7S, then prove that ST is nilpotent on V. What is 
the degree of nilpotence of ST? 


What can you say about the nilpotence of S + 7? 
16. Let 7: Vy > V, be defined by 
T(X 4. Xe» X3, Xq) = (0, 2x,, 3X, + 2xXq, Xe + 4x5). 
Then prove that 
(a) T is nilpotent of degree 4 
(b) For a nonzero scalar A, J -+ AT is nonsingular and (J + AT)" 
2: J— AT + AT! — ABTS, In particular, J + T and J — T are 
nonsingular. 
17. Let 7: P, -> F, be defined by 
T(aq + &,xX + ax? 4- gx?) == (49 + 20,)x? -+ (@, + a,)x®. 
Then prove that 
(a) Tis nilpotent gf degree 3 
(b) For a nonzero scalar A, J + AT is nonsingular. Find its inverse. 
18. True or false ? 
(a) If S:U-> V, 7: V — W are linear, then 
| (T 0 Sau) = ((aT) 0 (a5)\(u). 
(b) T(S(au)) = (2T\(S(u)). 
(c) If S is one-one, then 7S is one-one. 
(d) Every idempotent operator is nonsingular. 
(ec) A nilpotent operator can never be nonsingular. 
(ff) = T+ T= (TY), if T* exists. 
(g) If T is idempotent, then T* = T for all positive integers k. 
(h) If S:U—> PV and T:V -U are linear and ee fy, then 
§ = T, 


(i) If R,S, 7 are three linear transformations such that RST is 
defined and is one-one, then T is one-one. 


4.8 OPERATOR EQUATIONS 


Let 7:0 — V be a linear map from the vector space U to the vector 
space V. In this article we shall discuss the solutions of the equation 
T(u) = vy, (1) 


where v, is a fixed vector in V. Equation (1) is called an operator equation. 
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It is said to be homogeneous if y, = Ov. The set of solutions of the 
equation 
T(u) = Ov (2) 
is simply the kernel of 7, i.e. N(7T). If the equation is not homogeneous, 
le. ¥g # Oy in Equation (1), then (1) is called the nonhomogeneous (NH) 
equation and (2) the homogeneous (H) equation associated with (1) In 
this connection we have the following theorem. 
4.8.1 Thecrem Let 7: U -» V be a linear map Given, 7 0, in V, the 
nonhomogeneous equation 
(NH) T(u) = Vo 
and the associated homogeneous equation 
(H) = T(u) = 
have the following properties : 
(a) If v) & R(T), then (NH) Aas no solution for u. 
(b) Jf v, & R(T) and (H) has the trivial solution, namely, u — Ov, as 
its only solution, then (NH) has a unique solution. 
(c) If v, € R(T) and (H) has a nontrivial solution, namely, a solutian 
u 7: Qu, then (NH) has an infinite number of solutions, In this case 
if uy ts a solution of (NH), then the set of all solutions of (NH) is 
the lwear variety uy + K, where K = NUP) is the set of all 
solutions of (H). 
Proof: (a) is obvious. Recall the definition of R(T). 
(b) If v, & R(T), then 7(u) == vg has asolution. It 7(u) = 
has only one solution, i.e. u = Oy, then M7) = {Oy}, 1c. T 1s one-one. 
This means 7(u) = ¥, cannot have more than one solution. ie. the 
solution of (NH) is unique. 

oo ig (c) If T(u) == Ov has a nonzero solution, then M(T) * {Oyt. Let 
u, & U be a solution of (NH). It exists because 4) € R(T). Then 7(1) 
= ¥9. Now if uy € N(7), then 

T(uUy + Up) = T(t) | Tu) 
= Wg {- Oy = VN. 


Therefore, u tw is a solution of (NH). This is true for every 
u, € N(T), and since the latter has an infinite number of elements in it, 
(NH) also has an infinite number of solutions. 

From this discussion it is obvious that u, -+ K, where K == N(T), is 
contained in the solution set of (NH). Conversely, if w be any other 
solution of (NH), then 

T(w) = Vo = T (up) 
or T(w — ty) = Ov. 
This means w—% € M(T) = K. So w and u, belong to the same 
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parallel of K, namely, % + K. Thus, the solution set of (NH) is precisely 
uy + K.§j 

Note that u, -+ K is the 7-pre-image of Vo. 
Example 4.30 Let D: G0, 2x) > ¢7(0, 2%) be the linear differential 
operator. Consider the operator equation 

D(f\(x) = sin x. 
To solve this, we look at the associated homogeneous equation 
(H) Df=0. 
The solution set of this equation is the set of all constant functions. So 
K = {f | f(x) = 5 for all x E (0, 27) and b a constant} . 

One solution of D(f)x) = sin x is the function f, where f(x) 

= —cos x. So the solution set is 
frtk. 

In other words, the set of all functions g, where g(x) = — cos x + (a 
constant) is the solution set of D(f)(x) = sin x. 

To solve a nonhomogeneous operator equation 

(NH) T(u) = vy, 
where 7 is a linear operator, we go through three steps : 
Step 1 Form the associated homogeneous equation (H). 
Step 2 Get all solutions of (H). It is the kernel of 7, i.e. M(T). 
Step 3 Get one particular solution u, of (NH). 
Now the complete solution of (NH) is wu + M(T). 
Example 4.31 Let T : V, -> V; be a linear map defined by 
T(e,) = thy, Tes) = thy Tes) =f 
T(e,) = fa, T(e,) = 9, ; 
where {@,, 2, 3, €4, €;+ is the standard basis for V, and {/,, 4, f,} is the 
standard basis for V,. Then solve the equation 
, T(u) = (1,1, 0). 
We first calculate the value of 7(u), i.e. T(x, Xa, Xgs Xq, X5) : 
T(X1, ey Xgy Xqp Xp) == XyT(Cy) + X_T (Cg) + XsT(es) + x,T(e,) 
+ x57 (és) = (7 ys » Xy + X,, 0). 


The associated homogeneous equation leads to the equations 


Solving these, we get x, = —x,, X3 = —x,. Thus, the kernel of T'is the 
set of all vectors of the form (x,, —x,, X53, —Xa, X,), i.e. x,(1, —1, 0, 0, 0) 
+ x,(0, 0, 1, —1, 0) + x,(0, 0, 0, 0, 1). Hence, 

: N(T) — ((1, —1, 0, 0, 0), (0, 0, l, —I, 0), (0, 0, 0, 0, 1)] ° 
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One particular solution of 7(u) = (1,1, 0) is u = (2,0,1,0 0) 
which is obtained by putting x, =- 2, x, -- 0,x,= I, x, = 0, = 0. 
So the complete solution of the equation 

T(u) = (1, 1, 0) 
is the linear variety (2, 0, 1,0, 0) | M(7), i.e. the set 
2,0, 1,0, 0) + {(@, —a, b, —b, c) | a, b, ¢ are real numbers} , 
which is the same as 
{(a 4-2, —a, 5b -+ 1, —5, c) | a, b, ¢ are real numbers} . 
In other words, the 7-pre-image of (1, 1, 0) is this linear variety. 


Problem Set 4.8 


|. Determine the range, kernel, and the pre-image of (3, 1, 2) for the 
linear transformations R, S, T of Prob'em 1, Problem Sct 4.4. 


2. Find the 7-pre-image of (1, 2, 3) under the linear transformations T 
defined in (b) through (e) of Problem 1) Problem Sct 4.2. 


3. Find the 7-pre-image of the following two vectors under the linear 
transformation defined in (h) through (1) of Problem 1, Problem 
Set 4.2 : 


(a) x (b) x7. 


4.9 APPLICATIONS TO THE THEORY OF ORDINARY 
LINEAR DIFFERENTIAL EQUATIONS 


In this article we prop se to apply the theory of operator equations to 
the iniportant oper tor equation in mathematics, namely, the linear ordi- 
nary differential equation. For this we shall develop the theory of 
ordinary lmear differential equation, using the necessary concepts from 
linear algebra. 


The simplest linear ordinary differential equation of the first order is of 
the form 


a,(x) “ + a(x)y - g(x), (1) 


where a,(x), a,(x), and g(x) are continuous on an interval I. If a(x) is 
nowhere zero in J, then Equation (1) is called a normal linear differential 
equation of first order. If Equation (J) is normal, we can conveniently 
write it in the form 


dy 4 a,(x) g{x) 


— ‘ 2 
dx * a(x)” ~ a(x) Q) 
This is usually written as 


- | 
2 + Py=Q, (3) 
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where P and @ are continuous functions of x alone. We can rewrité it in 


operator form as 
(D+ Py=@ 


Ly == Q 9 (4) 
where L stands for the operator D + P which is a linear operator from 
6 (1) to ¢’(). Since L is a linear operator, we can look at Equation (4) 
as an operator equation. Therefore, we can apply the results of § 4.8. In 


Particular, we know that the general solution of Equation (4) consists of 
two parts. One part is the solution of the homogeneous equation 


or 


(H) Ly = 0 
and the other is a particular solution of 
The general solution of (H), i.e. of 
d 
ie t Py =0 (5) 


is called the complementary function and is denoted by ye. A particular 
solution of (NH), i.e. of Equation (3) is called a particular integral and is 
denoted by yp. 

Therefore, the complete solution of Equation (3) is of the form 

y=JYet+yp> (6) 

where yc is actually the kernel of ZL and yp is some particular solution of 
Equation (3). 

To solve Equation (3), we first find ye. We write Equation (5) in the 
differential form 


Pydx + dy =0 (7) 
or Pdx +- 5 dy=0. 
Integrating Equation (7), we get 
fPdx +iny=InC, (8) 
where C is an arbitrary constant. Equation (8) can also be written as 
= Ce—IPdx 9 (9) 


which is the required complementary function yc. Writing Equation (9) as 
yelPd= — C, we find that it is the solution of 
d JPdx 
ax (ye )=0, 


. fPdx |  fPdx dy _ 
i.e. Pye +e a 0. 


This gives the clue to “the solution of Equation (3). We multiply both 
sides of Equation (3) by eJP4 and get 


d Pdx Pdx 
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which on integration gives 
yelPdx — oelPdxg, | 
We are not interested in any arbitrary constant now, because we are 
looking for only one yp. So 
yp = e—SPdx fQelPdx. gy . 
Thus, the complete solution of Equation (3) is 
Y = Yo + yp = CeIPdx 4 e—JPdx pool Pde dy , (10) 
where C is an arbitrary constant. 


yxy 
Example 4.32 7 aaa oe eS 


er eee, (ee —— x 

Here P anf Q = x, and fPdx = Ia = dx 
= —tIn|x*—1]|. 

So el Pdx — et im| a8—1) ne 1 fy/x* 1 and e~SPdx — 4/77, 
Thus, 

yc = CY x cat | ’ 

area x . 
Vp = a/ x? — | dx = (x — 1), 
and the complete solution is y = ye -+ yp. 
Example 4.33 F 
ae t Py = Oy", nA. (11) 


This equation is the well-known Bernoulli’s equation. It is not linear, but 
it can be reduced to the linear form by the substitution 


dY dy 
—_— pl-n cf. — ees —n a 
yay, ok Coeay dx ° 
Equation (11) then becomes 
1 dY 
fon de +PY=Q. 

This is a linear differential equation and can be solved by the method of 
Example 4.32. 


Equation (10) represents a family of solutions (actually it is a linear 
variety). For each value of C, this is a curve in the xy-plane. If, in 
addition, we require a solution that satisfies the condition y(x) = ),, then 
the solution will be represented by a unique member of the family passing 
through (Xo, Yo). The problem of finding a solution y = y(x) for Equation 
(3), which also satisfies the initial condition y(x.) = yo, is called ax <nitial 
value problem for the normal first order linear differential equation. 


The foregoing discussion is summarised in the following theorem. 


4.9.1 Theorem Every initial value problem involving a normal first order 
ord nary | near differential equation has one and only one solution, 
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This is called an existence and uniqueness theorem—existence, because 
the theorem asserts that every initial value problem has a solution; unique- 
ness, because it further says that the solution is unique. 

Existence and uniqueness theorems are important in the theory of 
differential equations. Theorem 49.1 was easily provable. The corres- 
ponding theorem for the n-th order linear differential equation is beyond 
the scope of this book. However, we shall now state it (without proof), 
since we intend to use it in the theory that follows. 


4.9.2 Theorem Let 
Ney n},, 
BY aay Gg bot aledy’ = 8), (12) 
a(x) ¥ 0,x € IL be a normal n-th order linear differential equation 
defined, on an interval I. Let x. be a fixed point in I, Let a, a, ..., 
a,-, be n arbitrary rcal numbers. Then there exists one and only one 
solution of Equation (12) satisfying the initial conditions }(Xq) = %, 
Y (Xp) -— Lay eg POM TMXy) - 

The problem of finding a solution of Equation (12) satisfying the initial 
conditions, listed in Theorem 4.9 2, is called an initial value problem for 
the equation. 

This theorem is at the basis of all further theory of linear differential 
equations. [t says that every initial value problem involving a normal 
n-th order Jinear differential cquaticn has precisely one solution. We are 
now ready to state the main theorem of this article. 

4.9.3 Theorem TZhe solution space of any normal n-th order homozeneous 
linear ordinary differential equation 


a, fx) 


a,(x) oe +- a,(x) ae +... | aa(x)y = 0, (13) 
a(x) 4 0, x € I, defined on an int.rval I is an n-dimensional sub- 
space of ‘7 (2). 
To prove this theorem, we necd the following lemmas. 
49.4Lemma The solution space of Equation (13) is a subspace of 7 (1). 


Proof: We necd only to note that the differential operator 
I. = af(x)D" -+ a,(x)D"-) -++ ... + a,,(x) is a linear operator from 47 O“D) 
to '¢ (J), and so the solution space of Equation (13) is the kernel of L. 
Therefore, it is a subspace of ‘¥‘‘"(J). 
49.5 Lemma Let y,, yo, ...,), be n functions in %, (1) and x9 a fixed 
point in I. If the vectors v(x) = (y,(%q), VAXp)s jnagi Vet” 7 (Xs)), 
i= 1,2, ...,n of Vn are Li, then y4, Yo, ...5 Py are LI over I. 


Proof: To prove that y,, yo, ..., ¥, are LI over J, assume 
Cyy(X) + Coyo(x) +... + Cnya(x) =O forallxE J. (14) 
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The assertion is proved if we can show that Equation (14) holds only 
when ¢c, = ¢ = ... = C, = 0. 

Differentiating Equation (14) successively (” — 1) times, which is 
justified because y;(x), yo(x), .... ¥n(x) belong to %'"(), we get the 
following equations : 


ciyi(x) = + caye(x) fF . + Caalx) =O, 
o1yi(%) + cayo(x) +... + enyn() =0, 
CN (M(x) + coye'*-M(x) +... + Cals (*-D(x) = 0, 
for allx € J. Thus, for x» € J, we obtain 
C1Y1(%o) + CaYa(Xo) Ss Ct CrY n(Xq) =0, 
C1 1((Xq) + Cay 2(X) + oe HF CnVnl%) =, 


191!" '(Xq) se Coy,"" “Y)(Xq) a ge Ca (Xp) = 0, 
which 1s equivalent to 


101%), Yi(Xo), wey y1"-Y%)) + c(Vo(%o), Ya(Xq)s ney Vox) + 
LF Ca(Yn(Xo)s Vn(Xo)s «+s Yn’ '(%q)) = 0. 
In other words, ¢,¥,(X9) 4 ¢,¥e(X%q) +... + CaYn(Xo) = 0. Since y,(Xp9), 
i -1,2,  ,m are Lt in V,, all the scalars c,,c.,  ,C, are zero. Hence, 
Vis Var «- » Yn are Lt over J. 


Proof of Theorem 4.9.3 By Lemma 4.9.4, the solution space of 
Equation (13), denoted by K, is a subspace of “ ‘"(7). We shall now prove 
that dim K -= n. 

Let x, be a fixed point in J. Then, by the existence and uniqueness 
theorem, there exists a unique solution y; satisfying the initial conditions 
Yil(%o) = 1, v1 (x) = 9, Vi(Xq) = 0, .. , Wr'%—Y(Xp) = O. 
Similarly, there exist unique solutions ye, 3, .- , Yn Satisfying respectively 
the initial conditions 
Y2(X_) = 9, Yo(Xp) = 1, yo(x) = 0, ..., ye'® P(X) = 
Yale) = 0, ys (%) = 0, 2a hy Scares = 


) = 0, yt (Xo) = 0, 92%) cal 0, “9 vais U(x) = 
From this it is obvious that (y,(Xo), ¥s(Ag)s «++» Ve" (Xp), E = 1, 2, 
.,m, are the vectors €,, &s, ..,¢€, Of V,. Therefore, the vectors (y,()), 

V(Xo)y «ees Vs'"-(xq)), F = 1, 2, ++, m, are LI in Vz. Hence, by Lemma 
4.9.5, Vis Ves «+» Yn are LI over J. : 

We shall complete the proof of the theorem by showing that the 
solutions y:, Ys, -+-» Yn generate the space K. 

Let y be an element of K, satisfying the initial conditions 

W(X) = %, Y'(Xq) = Ae, --- » Y-N(Xq) = Aq. 

Consider the function oy; + oy, +... + %nYn- This is clearly a solution 
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of Equation (13) satisfying the said initial conditions. Hence, by the 
uniqueness part of Theorem 4.9.2, y = ay; + ... + Gyn. So y E [, 
Yas +++» Val: 

Thus, the set {y,, Ve, ---» ¥nj iS Lt and spans K, which means that the 
set {V1, Ve, ---» Yn} is a basis for K. Hence, dim K = n. 

From Theorem 4.9.3, the following corollary is obvious. 


4.9.6 Corollary Jf 1, Ya, ..:> Yn are n linearly independent solutions of 
Equation (13), then any solution of Equation (13) can be written as 
Ci + Cove +... + Coyne 
In Theorem 4.9.3 and Corollary 4.9.6 we have discussed in detail 
the solution of the homogeneous normal linear differential equation 
Ly = 0, where L = a,(x)D® + a,(x)D*®1 + ... + @,-:(x)D + a,(x). We 
now consider the nonhomogeneous equation 
Ly = g. (15) 
Since L is a linear operator from %°"(J) to & (J), Equation (15) can be 
considered as an operator equation. Hence, by Theorem 4.8.1, the 
general solution of Equation (15) is the L-pre-image of g. It is the iinear 
variety yp + jc, where yp-is a particular solution of Equation (15) and ye 
is the kernel of L. We summarise this result in the form of a theorem. 
4.9.7 Theorem Let 


" n—1 
aglx) S2 + a(x) Or) Eon Ho aalxly = (2) (16) 


be a nonhomogeneous normal linear differential equation on an interval 
I. Then the set S of all solutions of Equation (16) is a linear variety 
S = yp + Ye in GL), where the leader yp is any one solution of the 


equation and y¢ is the set of all solutions of the associated homogeneous 
equation. 


Problem Set 4.9 


1. Solve the following differential equations ; 


(a) rd — ym xe (b) x 9 + y =a + axtcosx 
(c) (4—3¥) 7 — Sy = xi/(3x— 4°" (d) a + ay = eM 


() tw Bay ) Baoxtpyts 


(g) (tan™’y — x) Y =1-+y* (h) sec y dx — (x+cos y)dy = 0 


(i) (y? — I)dx + (2x — y*? + I)dy = 0 
(j) cos y dx + (xsin y — 1)dy = Q 


4.) APPLICATIONS TO DIFFERENTIAL EQUATIONS | 147 
dy .; 
(k) (x® + l) = + xy = sinx + xe®* + 2 


1) 2 
Q i ee ae _ 
Gh ead) dx © x(1 4+ x*)° 


2. Solve the following differential equations : 


3. 


@) (+x Law-y ) Baxyi-y 


(c) = + ye = xy  (d) etd = x(2xy + e)dy 
(e) cos y dx + x(x — sin y)dy = 0. 
In each of the following differential equations, verify that the given 


functions are solutions. Determine whether they are L1 and whether 
they form a basis for the solution space. 


(a) yp” + 5y’ +- 6y = 0; e727, e732 on (— 00, 00). 
(b) y”’ — 4y’ = 0; e*, e7# on (—a, o), 

(c) x*y” — 2xy’ 4 2y = 0; 2x? —x, x? | 2x, x? on (— 0, 00), 
(d) y" — y” -*2y’ = 0; e-%, sinh x — e*/2, 2e77, 1 on (- 0, 0). 
}— 


(e) y” — 2xy'/(1 — x*) = 0; 1 — tanh-'x, 1 + In L439 


(—1, 1). 
(f) (D*‘— 4D? 4 7D* — 6D - 2)y == 0; xe*, e*, e*( 1 — sin x), 
e” cos x, e*(sin x — x) on (— 0, 0). 
(g) (x°D? + 3xD + 1)y = 0; 1/x, In x/x on (0, ©). 
(h) (xD? — D*)y == 0; 1. x, x® on (0, 00), 


, 2on 


Chapter 5 


Matrices 


Matrices form an important tool in the study of finite-dimensional 
vector spaces. Determinants form an important tool in the study of 
matrices. We shall study matrices in this chapter ard determinants in the 
next. 


Hereafter, though for convenience we deal with real vectors and the 
seal vector space V,, all our arguments and definitions, unless otherwise 
restricted, will apply also to complex vectors and the complex vector space 
Ve, 

n 


5.1 MATRIX ASSOCIATED WITH A LINEAR MAP 


For the theory of matrices, it is sometimes necessary to visualise 
vectors of V, (any p-dimensional real vector space is isomorphic to V,) 
as column vectors, i.e. a vector (x1, %, ..., %,) Of V, may be written in the 
form 


Po | 
a 

; 
La _] 


where coordinates of the vector are written in a vertical column read from 
top to bottom. It may be noted that so far we have been writing this as 
a row vector, i.e. in a horizontal row from left to right. To save space, 
column vectors are also written as («;, %, ...,@,)7, where the letter 7 
denotes that the vector is a column vector. (The appropriateness of the 
letter 7 will become clear later.) 


For example, the vectors e,, es, and e, of V; may be written as 
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Tr iyron [0 


| bal | 


L_O_j LOZ {1 
or as (1, 0, 0)7, (0, 1, 0)7, and (0,0, 1)7. If v = 2e,- 3e, -+ es, then 
the coordinate vector (2, —3, 1) of v relative to the basis {e,, e,, e,} can be 
written as 


(— 2 : 
| —3 i (2, —3,1)T. 
L 1 _J 


Before we discuss the general definition of a matrix, let us take a simple 
example: Let B, = {u,, ty, Ug} and By -- {¥;, Ve, Vg, Vg} be ordered bases 
of V; and V,, respectively. Let 7: V, ~ V, be a linear map defined by 

T'(uy) = v, — 2ve + Vs — Vg 
T (ue) = Vy Ve + 2% 
\ T(t) = 2. + 3V, — Vg - 
Then the coordinate vectors (relative to B,) of T(u,), T(u,), ard T(u,), 
written as column vectors, are respectively 


a ae eee ee [~ O77] 


—2 —] 2 
‘ , and 
1 0 


itd A 25 a el 
Everything about the linear map T is contained in these 3 x 4 = 12 
numbers, written as above. The arrangement of these 12 numbers in the 
form 


~ 1 1 OF 
| —2-—1 2 

1 0 3 
L—l 2-1 


is called the matrix of T relative to B, and B,. 
We shall now give the general definition of a matrix. 


5.1.1 Definition Let U and V be vector spaces of dimensions ” and m, 
respectively. Let B, = {t), ..., Un} and By == {v, ..., Vm} be ordered 
bases of U and PV, respectively. Let T:U>V be a linear map 
defined by T(u,) == 04,¥, + O%a)¥q + ++ + OmiY¥m J = 1,2, +50 SO 
that the coordinate vector of 7(u,) written as a column vector is 
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[" Oy “| 


X25 


L mj _I 
Write the coordinate vectors of TZ(u,), T(ue), «+, T(u;), » , T(Un) 
successively as column vectors in the form of a rectangular array as 
follows : 
[yy Hyg nee yy ne tn | 


qx Mag +e Hy, 20. on 
6 
: 


| % m3 Ag «se Amy ce omn— 
This rectangular array is called the matrix of T relative to the 
ordered bases B, and B,, and is denoted by (7: B,, B,). 


It may be noted that in this definition «,; is the 7 th coordinate of T(u,) 
relative to the basis {v,, vo, -+ , Ven}- 


5.1.2 Remark The numbers that constitute a matrix are called its entries. 
Each horizontal line of entries is called a row. Each vertical line of 
entries is called a column. The above matrix has m rows and n 
columns. The matrix is therefore called an ‘m x n’ (read as m by n) 
matrix. The order of the matrix is said to be ‘m x nm’. The/j-th 
column of the matrix is a column vector (a,,, &;, ...; &m,)7, and may 
be considered an element of V,,. The i-th row of the matrix is a row 
vector (0,1, %,2, -» , %,,,), and may be considered an element of V, 
The matrix is denoted, in short, by the symbol (¢,5); — 1, .. _m OF 

Jel. mn 
simply (&,;)mxn- %.4 is called the ij-th entry, and it is at the inter- 
section of the j-th row and the j-th column. 


Example 5.1 Let a linear transformation T7:V,— V, be defined by 
T (X13, Xq) = (X, + Xe, 2X, — Xa, 7X2). 

If B, = {e,, e,} and B, = { fi, fe, fa} are the standard bases of V, and 
V,, respectively, then 


Tes) = fi + e+ % 
and Ties) =~ fi —fe + Th. 
The coordinate vectors of 7(e,) and T(e,) are respectively 
ri [> wa 
2 — | 


Lo L 7 


and 
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Therefore, the matrix of T relative to B, and B, is 


rio 34 
2-1 |, 
LO 7_J 


Exampie 5.2 Let a linear map T: V3 —> V, be defined by 7(x;, Xs, X5) 
== (1 — Xq + Xg, 2X1 + 3x_ — 4X5, XH + X_ — 2%5). 

If B, = {€;, é:, és}, the standard basis, and B, = {(1, 1, 0), (1, 2, 3), 
(—1, 0, 1)}, then T(e,) = (1, 2, 1) = 2(1, 1, 0) + O(1, 2, 3) + 1(—1, 0, 1). 
So the coordinate vector of J(e}) relative to B, is (2,0, 1). Similarly, the 
coordinate vectors of T(e.) and 7(e,) relative to B, are (6, — 3/2, 11/2) and 
(0, —1/4, —5/4), respectively. Writing these successively as column 
vectors, we get the matrix of 7 relative to B, and B, as 


r2 6 07 
0-2-3 
Li 4 84 


Example 5.3 Let ailinear map JT: V,-> V, be Gefined by 7(e,) = 2f, 
—fo, T(es) =f, + 2fe, Tles) == Of; + Ofe, where {e,, eg, e,} and (fi, fy} 
are standard bases in V, and V,, respectively. Then the matrix of 7 
relative to these bases is 

(~ 21 04 


| : 
L—l 2 0_J 
Let us find the matrix of the same linear map 7 relative to some other 
bases, say B, = {(1, 1, 0), (1, 0, 1), (0, 1, 1)} and B, = {(1, 1), (1, —1)}. 
We have 
TX, X%gy X53) = XT (e,) + XT (Cg) + X37 (es) 
== (2x; + X23) fi + (2%, — x1) Sf 
= (2X1 + Xa, 2X2 — 3). 
Therefore, 7(1,1,0) = (3, 1) = 2(1, 1) + 1(1, —1) 
T(0,1,1) = (1, 2) = (1, 1) — 401, —1). 
Hence, the matrix of 7 relative to B, and B, is 
% + FF 
Li # tl 
Note that the matrix of 7 changes when we change the bases. We 
shall pursue this matter in Chapter 7. 


Example 5.4 Letalinear map T: ?,— 9, be defined by T(x + ax + 
gx? +L ryx5) =e arg + (ag + atg)X + (xy + a,)x% Let us calculate the 
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matrix of T relative to the bases B, = {1, (x — 1), (x — 1)*, (x — 1)°} and 
B, = {1, x, x3}: 

Til) =x* =0-t+0x 4+ 1H 

T(x —1)) =0=0-1-+ 0x 4+ 02? 

Tix —1))) = x—a?=0-1 + Ix — 1x? 

T((x — 1)8) — 1 — 2x + 2x? = 1- 1 — 2x 4 22°. 
Hence, the matrix of T relative to B, and B, is 

(0 vu 4) 1) 


0 0 1 —2 


L1 0 —1 2_| 

Example 5.5 Let D: P5 —> Pq be the differential map D(p) = p’. Let 
us calculate the matrix of D relative to the standard bases {!, x, x, x*} and 
{1, x, x7}: 

Dil) =0 =0-1-+4 Ox + 0x? 

D(x) =1 ~—~1-1+ 0x + 0x 

D(x*) = 2x = 0-1 + 2x + 0x° 

D(x) = 3x*= 0-1 + Ox + 3x’. 
Hence, the matrix of D relative to the standard bases is 

(~“O 1 0 07 


002 0]. 


{0 00 3.) 
Example 5.6 We can easily check that the matrix of the identity map 
1; U + U (dim U = n) relative to a basis B(B, = B, = B)isthen x n 


matrix 
| 0 0 .. O71 


(1) 


LO oOo oOo. It 
This matrix is called the identity matrix and is denoted by /, (or simply 
I, if 2 is understood). 


The ij-th entry of this matrix is usually denoted by §,,, where 5,,, called 
the Kronecker delta, is defined by 
1, if i=/ 
&,= 4.’ 
“ ‘0° if ix]. 2) 
So J, is the matrix (8,;) nxn. 
Example 5.7 Using the same procedure as in Example 5.6, we can check 
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that, whatever the bases used, the zero map 0 PV, Vin will have the 
matrix 
~-oO oO .. O07 


(3) 


| 
LO oOo. 0_] 


Each entry in this matrix 1s zero. This matrix is called the zero matrix 


of order m X nand 1s denoted by 0,,,, or simply 0, if the order is under- 
stood. 


Problem Set 51 


In Problems | through 7 deteimine the matrix (7 . B,, B,) for the given 
linear transformation T and the bases B, and B, 


1, T: Vy-> Vy, T(x, ¥) = (x, --y) 
(4) By = {e,, e,}, By = {(I, 1), (I, —1)} 
(b) B, — {(1, 1), (1, 0)}, Be = {(2, 3), (4, 5)} 
2 T Vz >V,, T(x, y,z) = (x4 3,y4 2). 
(4) B, = {(I, l, 1), (1, 0, 0), (I, ), 0)}, B, = {€1, e} 
(b) B, = {(1, 1, 3), (-1, 2, —), (2, 3, 3)}, B, = {(, 3), (4, 1}. 
3. Ts Va > V5, Try, Xa Xq9 Xq) = (2Aq + oy Ve — X39 Xg + X4s V1, 
yt Xe, 4 Bay + X,). 
B, = {(1, 2, 3, 1), (1, 0, 0, 1), «l, 1, 6, 0), (0, 1, *, 1)} 
B, = {€), €2, €3, Cas ss 
4. D: Pn Pa; D(p) =p 
B, = B= {l, x, x",. ,a%}. 
5 T. Py > Pa, T(p)(x) = S$, p'(t) dt. 


(a) B, = B, = {I, x, x*, x', x*} 
(b) B, = {l, a, x*, x3, x4}, B, = {x —1,x + 1, x? — x4, x® + x4, 
x* + x}. 
6. Ts Pe Ps, T(p) = xp(x). 
(a) B, = {1,1 +x 1—x + x*}, B, = {1,1 4+ x, x*, 2x — x3} 
(b) B, = {1, x, x}, By = {1 + x, (1 + x)%, (1 + x)3, 1 — x}. 
7. T: VE > V%, T(z, Z:) = == (Zz, + IZ, Z,; — iz). B, and By are stan- 
dard bases. 


8. Determine, relative to the standard bases, the matrix of each linear 
transformation 7 in Problems 1(a) through 1(g) of Problem Set 4.2. 
9 True or false ? ° 
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(a) Let 7: V, > V, be a linear map. Then the matrix of T relative 
to any pair of bases is of order 4 X 6. 


(b) When referred to the standard basis, the matrix of the linear 
map 7: V,—-V, defined as (x, y) > (x’, y’), where x = 
x’ cos 9 — y’ sin 0, y = x’ sin 6 -+ y’ cos 9, is 


(cos? —sin 071 
| 


L_sin 6 cos 0_! 
(c) The matrix of the identity map Jy : U — U relative to any pair 
of bases ts the identity matrix. 


~0 007 
(d) 1 0 0 | 1s the matrix of the linear map 7: V,— Vs; 


LO 0 0-J 
defined by T(e,) = 0, T(e.) = ¢,, F(es) = 0 relative to the 
standard bases. 


roo 171 


| 
(e) 1 0 0 | is the matrix of the linear map T : V, — V, defined 


LO 1 0 | 
by e, = T(e3), C2 = T(e,), @3 = T(eg) relative to the standard 
bases. 

(f) To every linear transformation there corresponds a unique 
matrix. 


5.2 LINEAR MAP ASSOCIATED WITH A MATRIX 


In § 5.1 we started with a linear map and then defined its matrix. 
However, in order to define a matrix, it is not necessary to start from a 
linear map. Matrices can be considered as entities in their own rights as 
the following definition will show. 


5.2.1 Definition Any rectangular array of numbers such as 
[Biz Big +++ Bay oo Bin | 


Por Bon + Bes ++ Ban | 


Pir Bre + Bis wes Bin 


Pa Brea as Bins oy Ban] 
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is called an m x n matrix. If m = n, the matrix is called a square 
matrix. 


Two matrices A = (a,,)my, and B = (f,,)mxn are Said to be equal, 
written as A = B, if «,; = 8,, for every i and j. 


All the statements in Remark 5.1.2 also apply to a general matrix as 
defined in Definition 5.2.1. 


A matrix whose entries are all real (complex) numbers is called a real 
( omplex) matrix. 


As already mentioned, our discussions in this chapter deal with real 
vector spaces, ie. V, and V,,. Also, the matrices used will be real. 
However, all the discussions hold for complex matrices if the real vector 
spaces V,, and V,, are replaced by the complex vector spaces VC and VC. 


Let us start with a matrix B = (8,,)mx, and ask whether we can find a 
linear transformation 7: U —- V, where U and V are suitable vector 
spaces with ordered bases, say B, and B,, so that B = (T: B,, Ba). 


The answer to this question is yes, because the process of obtaining the 
matrix from a linear transformation (see Definition 5.1.1) 1s reversible. 
Let us go through the steps of this reverse process. 


Let the matrix B = (B,;)mxn be given. Using this matrix B, we shall 
define a linear map S: U-+ V, where U and V are vector spaces of 
dimensions n and m, respectively. 


Let B, -= {u,, U2, .., Un} and B, = {v,, Ve, ...) Vm} be ordered bases for 
U and V, respectively Then we define a linear map S: U -> V by pres- 
cribing values of S on the vectors of B, as follows : 


S(u) a Pus 7 BoiVe + ... + BmiYm > 
Sus) = Bu + Bee +... + Bim ’ 


Sun) = BanYs + BanYa + = + Bava 
Extend S linearly to the whole of U. The linear transformation S is 
unique (Theorem 4.1.5). By this very construction, it 1s clear that 
= (S: B,, B,). For this purpose, we have only to note that the coordi- 
nate vector of S(u,) relative to B, is the j-th column of B. S: U — V thus 


defined is called the linear map associated with the matrix B relative to 
B, and B,. 


Note that an m X n matrix gives rise to a linear map from an n- 
dimensional vector space to an m-dimensional vector space. Further, note 
that, if we choose bases other than B, and B,, the linear map associated 
with the matrix B will also be different. 


Example 5.8 Considera4 x 3 matrix 
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{ | 2 ~—2_] 
This matrix will give rise to a linear map S: V,—> V4. Suppose 
B, = {uj, Up, us} and By = {¥4, vy, Vy, V4} are ordered bases for V, and V,, 
respectively. Write 


Sly) = 2y +, —2y,+ vy 
S(ug) = —3v, + Wy + 2, 
S(us) = 47, — Vy —~ 2V,. 


The linear extension of this definition of S on the basis elements is the 
required map S. If B, and B,are the standard bases {c,, e.,e,} and 
{Sis Ses Ss, fa} for Vz; and V,, respectively, then we get a linear transfor- 
mation T : V, > V4 given by 

T(e,) = (2, l, —2, 1), T(e) ree (—3, 0, l, 2), T(es) acl (4, Ky 0, 2), 
i.e. T(Xy, Xe_ Xg) = (2X, — 3X_ + 4X5, X1 — Xg, —2X, + Xo, 

Xy + 2x, + 2xz) . 

Let NM. » denote the set of all m <= m real matrices. Let U and V be 
real vector spaces of dimensions n and m, respectively. Fix ordered bases 
B, for U and B,for V. Then the process of determining the matrix of a 
linear map and the linear map corresponding to a matrix shows that the 


map 
7+: L(U, V) —> Masa (1) 


defined by 1(7) = (7 : B;, B,) is one-one and onto. 

This result merely says that, if bascs B, and B, are fixed, then to each 
linear map 7: U — V there exists a unique m xX n“ matrix and to each 
m X n matrix there exists a unique linear map from U to V. This enables 
us to pass from linear transformation to matrix and vice versa. 

When U = V,, and V = V,, and the bases B, and B, are the standard 
bases in the spaces, then the matrix associated with 7: V, — V» is called 
its natural matrix. 

Note (cf Example 5.7) that (0) = 0, x.,. Further, note (cf Example 


5.6) that, if 
<7: L(U) > Masa (2) 


then +(Z) = J,, where J is the identity transformation on U, and J, is the 
n X n identity matrix. 


Problem Set 5.2 . 


In Problems 1 through 4, for each given m xX n matrix A and bases B, 
and B,, determine a linear transformation 7:V,-> V,, such that 


A= (T : B,, B,). 
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~1 1 2 371] 
a=[1 61-1 


1, 2 90 0_) 
(a) B, and B, are standard bases for V, and V,, respectively 
(b) By = {(t, 1, 1,2), (1, 1,0, 9), (0, 0, 1, 1), (0, 1, 0, O)}, 
B, i {(1, 2, 3), (1, =1; 1), (2, [, 1)}. 


~1 0 07 
A=; 0 1 0 


100 1 
(a) By, = B, — {é1, 2 3} 
(b) B, - {(1, 1.1), (1, 0, 0), (0, t, 0)}, 
B, =- 401, 2,3), (I, 1,1), (2, 1, 1)} 
(c) B, -- {(1, 2, 3), (l, —1, 1), (2, 1, 1}, 
B, =- {(1, 1, 1), (1, 0, 0), (0, 1, O)}. 
rho. 27 
| 3 1 Of 
(a) B, and B, are the standard bases for V, and V,, respectively 
(b) B, oe {(1, i 1), (I, ye 3) (I, 0, 0)}, 
B, - {(1, Dey. 1)} 
(c) By — {(1,_ !, 1), (I, 2, 0), (0, - 1, 0)}, 
B, a {(f, 0), (2, 1)}}. 


(~ 1 2) 
A= 0 1 
L.-1} 3.1] 


(a) B, and B, are standard bases for V, and V;, respectively 
(b) B, = {(1, 1), (—I, 1)}, 
B, pac {(1, I, 1), (1, _ i; 1), (0, 0, 1)} 
(c) By = {(1, 2), (-2, 1}, 
B, ae i(1, = I, —1), (I, 2, 3), (> l, 0, 2)}. 
If [ cos @ - sin 67] 
{ sin 6 cos 0_] 
relative to the standard bases, then find the matrix of 7-! relative to 
the standard bases. 
True or false ? 
(a) The matrix of the linear map 7: U — V is square iff dim U = 
dim V. 
(b) An identity matrix is a square matrix. 
(c) A zero mairix is a square matrix, 


is the matrix of almear map7: V,—-> V, 
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~! 0 OF 
(d) 0 0 1 | is the matrix of the identity transformation 


LO 1 OJ 

I: V, — V, relative to the bases B, = {€), es, €,;} and B, = {¢1, 
C5 Cg}. 

1 a 


(e) 0 1 determines a linear transformation from V, to Vs 


Lt tj 
defined as T(e,) = fi, T(e:) = fe, T(es) == f, + fo relative to the 
standard bases {e,, ¢,, e,} and {f,, ft}. 


5.3 LINEAR OPERATIONS IN y,,,, 


Throughout this article U and V are real vector spaces of dimensions 
n and m, respcctively; and B, = {u,, ta, ..., Ua} and By = {v,, Vo, ..+5 Ven} 
are ordered bases for U and V, respectively. 

Let JT and S be two linear maps from Uto V. Then T + S is also a 
linear map. If the matrices of 7 and S relative to By and B, are A = 
(a, s)mxn and B = (Bis)mxns respectively, then 


T(u;) = = 4 5V, VG = 1, 2, -.-, n) (1) 
and 
S(u,) = 2 B, iV; (Vj = 1, 2,..., ™). (2) 
So (T + S) (uj) = T(u,) + S(u)) 
= By (213 + Beye (7 = 1, 2, «MD. (3) 


Therefore, the j-th column of the matrix of T + S relative to B, and B, is 


(015 + Bys, Hoy + Bay, .00y Xe Bigs «209 Smz + Bing)? . 
Hence, the matrix of T + S is 


[“%. + Bir Og + Big... Oyy + Bry.) Gin + Bin 
Os: + Bar Mag + Bag --» Cay + Bay ... Sen + Ban 


Oey Ht Ber sg H+ Big ee Oey + Beg oe Gin + Ben 


Litt Bayz Ong Begg oe Sens tt Bing cee Og ep 
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This motivates the following definition of addition of matrices. 


§.3.1 Definition Let A = (a,,) and B = (B,;) betwomxz matrices. Then 
the sum A + B is defined as the m xX n matrix («,; + 8,,). 
In other words, the sum of two matrices (of the same order) 1s obtained 
by adding the corresponding entries. 
Example 5.9 Let 
-~l 3 274 (~“—-1 2 179 
A= | |, B= |. 
| 0O—1 1_] L 3 1 2.4 
f~-1—1 342 24+1)°1 FO 5 34 
Then A+B=| | = | |. 
LO+3 —1l1+1 14+2.J) £3 0 3] 
5.3.2 Remark The argument preceding Definition 5 3.1 says only that the 
map +: L(U, V) -> Mas» Of § 5 2 preserves addition, 1. 7(T + S) == 
<(T) + +(S) for all T, SE LU, V). 


Let 7: U— V be a linear map ande«a scalar. Thena7T:U— Vis 
also a linear map. If the matrix of T relative to B, and By 1s (2.5) x95 
then 


m 
Pu) = % mah (j= 1,2, +m). (5) 
é 


So (a7) (uj) = aT (u,) = z (a,,)¥, G7 = 1, 2,..., 1m). (6) 


Therefore, the j-th column vector of the matrix of «7 relative to B, and 
By, 1s 

(oy), FO ayy oor, 1M, 5, won, Lens). 
Hence, the matrix of «7 1s 


ee en Sr ea 
ed 5 Med T tl F) soe ANen : (7) 
[ny hg vee hy ws rey | 


This motivates the following definition of scalar multiplication for 
matrices. 


5.3.3 Definition Let A = (a,,) be anm x n matrix and «ascalar. Then 
the scalar multiplication of A by « denoted by «A is defined as the 
m X n matrix (a«,,). 
In other words, multiplication of a matrix by a scalar « is done by 
multiplying cach entry by «. 
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Example 5.10 Let 


rk 3 2] 

A = | |. 

LO 1 1J 
r—} -2 -17 
Then (—3)A = se 
LO -2 —3_J 


5.3.4 Remark The argument preceding Definition 5.2.2 says only that 
the map t: L(U, V) > Mu, n of § 5.2: preserves scalar multiplication, 


ie. t(a7) = at(T) for all TE LU, V). 


From the definition of addition and scalar multiplication it immedi- 
ately follows that Man is areal vector space. (The reader is advised to 
go through the various steps of verification.) Note that the zero element 
of this vector space is the zero matrix 0,,x, of Example 5.7. 


Further, Remarks 5.3.2 and 5.3.4 show that the map +: L(U, V) 
—+> Mm n iS linear. Since we have already proved in § 5.2 that t is one- 
one and onto, it follows that t is an isomorphism. We collect all these 
results in the form of a theorem. 


§3.5 Theorem (a) Mir.n is a seal vector space for the forezoing 
definitions of addition and scalar multiplication. 
(b) +: L(U,V) > Mans n defined by (T) = (7: B,, B) is an iso- 
morphism. 
The implication of this theorem is that, for all practical purposes of 


linear algebra, linear transformations between finite-dimensional vector 
spaces are just matrices and vice versa. 


We shall now determine the dimension of Z(U, V). By Theorem 5.3.5, 
it is the same as the dimension of Mn, », because isomorphic vector spaces 
have the same dimension. (Why ?) So we have only to prove the 
following theorem. 


5.3.6 Theorem The dimens‘on of the vector space N,,, , is mn 


Proof: Given i and j, define the matrix £,; as the m x n matrix 
with | in the j-th entry and zero in all the other entries. We claim that 
the set B of matrices 

B = {Ey15 cers E ins Eu, eer, Ean aie | Oe oveg Ean} 
= {E;; E Maw n | i a l, aces m; J = I, one g at 
is a basis for Wun, a: 
To prove that B is if in Ma, n, We assume @ Ey, -+ ... + OnE sn 


+ OgFg, + ... + SanE an + nee + SmEm. + 0+ + OmnE my = mxn- This 
means that 
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[Oy yg «e Sn 1 FO 0... 07 


Key Cog os. Oey 0 0... O 


Ltm1 Ome + Gant LO O . O_J 
Hence, «,, = VU for alli=1,...,m and j= 1,...,.m. Thus, B is 11. 
Again, to prove that [B] = Ma, a2, let us take a general matrix A = 
(¢,;) IN Mma» Then it can be easily verified that 
A= 4 ,Ey, | + nin + %)F oy +. + OnE on + Cm Emi 
Tt ooo + Sending - 
Hence, B 1s a basis. Hence the theorem. § 
The basis {E,, [+ 1,...,mj= 1,...,m} 1s called the standard basis 
for Man. n- 
Combining Theorems 5.3.5 and 5 3.6, we have the following corollary. 
5.37 Corollary If U and V are finte-dimensiosnal vector spaces, then 
dim L(U, V) dim U x dim V. 


Problem Set 5.3 


In Problems | through 4 determine «A + 8B for the given scalars « 
and 8 and the matrices A and B. 


[te eee 24 rio 17] 
{| —1 1 1.] L211 —1_J 
(a) a=2,8 =7 (b) «0 = 3,8 = —2. 
Tl 24 rl 0O7 
2. A= | |, B= | ba 
L3 1_J L2 —1_J 


(a) a= 3,B=5 (b) a= 2,8 = -3. 
fr 123 44 -3 -1 2 07 
3. 4-| —1 1 1 1 |.2 1 5 7 3 . 
L 3 1 2 0] L2 1 ¢ 1_J 


(a) «=2,8 = —6 (b) a=3,8 = 5 
(c) ax —7,8 = 3. 
ci -1) -1 0 2 


2 -3 -1|,2-[0 1 i 
13 2 Oo L3 1 -! 


4, A= 
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10. 


il. 


(a) a=7,8 = —5 (b) a == 1/2, B = 2/3 
(c) a = 1/3, 8 = 4/5. 
Let 7,,7,:U->V be two linear maps. Let By B, be ordered 
bases for U and V, respectively. Then prove that 
(4,7, + %%q i By Ba) = % (7, : By, Bz) -+ %(Z : By, Be). 
Let S, 7: V3 -> V, be defined as 
S(X1, Xq, Xy) = (Xy + Xo, Xy — 2g + Xy, Xq + 3Xg, Xy + Xp) 
T(Xy> Xe, Xg) = (Xy + 2g, Xy — Hq, 3X_q + Xgy Xy + Xe + Hy). 
Determine the matrix of 3S — 47 relative to the standard bases by 
two different methods. 
Let S, T: Ps -> P, be defined as 
(S(p))(x) = (x? — 1)p’(x) 
(T(p))(x) = (3x + 2)p(x) —- SF p’(ndte. 
Determine the matrix of 4S + 27 relative to the ordered bases 
B, = {1, x, x*, x*} and By = {(1 — x), (1 + x), (1 — x)’, (1 — x)’, 
x*/2} by two different methods, 
Let B, = {t4,, Us, .... Un} and By, = {v,, Vg, +++, Vn} be ordered bases 


for the vector spaces U and V, respectively. Define 7;;:U —> V, 
!<i<cm,1<a4j< msuch that 


rio = {9 EEAt 
Then prove that 


(a) (7,,: By B.) = E,; (ef Theorem 5.3.6) 
(b) {T7,,} is a basis for L(U, V). 
Define 7: M., 9 —> MWe, 5 such that 


r| a ae + M19 0 Gig + =| 
X29 Xa + Ogg 0 ) 


Prove that T is linear and nae its matrix relative to the 
standard bases for M,, . and Mg, s. 


Repeat Problem 9 for 7: M,, 5 —> Me, ¢ defined as 


- [“ Cas a) |“ TF %qg + Mg = gy | 
Oey Ugg Xqy_] O19 Cae + Meg 


Let V be the subspace of ¢'™)(— 00,00) spanned by the functions 
sin x, COS x, Sin x cos x, sin? x, cos? x. Determine the dimension of 
V, and prove that the differential operator D" maps V into itself for 
every positive integer n < m. 

Determine the matrix of (a) 2D + 3, (b) 3D* — D + 4 relative 
to the basis of V obtained from the given spanning set of V. 
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rc23 17 74 6 £6917 
(a) | | + | | = 


L457) LS -1) L9 4 at 


("a 307] 1 34 
(b) | | = a6 | [ . 
L2pB 46_] L2 4) 


(c) OA = 0,.x, for any m XX n matrix A 
(d) The set of all square matrices 1s a vector space. 


(e) Every matrix can be written as the sum of two matrices, one of 
which 1s two times the other. 
(f) The set of all 3 x 3 matrices of the form 


re. = B77 
y oO 68 


| 6 p 0 _I 
1S a group under the operation of addition. 


5.4 MATRIX MULTIPLICATION 


Hereafter, we shall use only standard bases in the vector spaces V,, 
unless otherwise stated. 


In this article let S: V, > V, and T: V, -> Vi be limear maps. Let 


B, = {e1, Ca, * 9 ends B, = {hi Sos oe sSints and B, — {21, 82> eo 9 &>} be the 
standard bases for V,,, V,,, and V,, respectively. 


Let the natural matrix for T be A = (4,,)mxn, and that of S be 
B= (Bis)nxp 


We know that TS: V, > V,, is also a linear map. Let the natural 
matrix of TS be C = (y,,)mx>- We shall now calculate y,; in terms of «’s 
and f’s. We have, for each k = 1, 2, .., 7, 

m 
I (ex) = % urs 
{= 


= OinSs + hex Ss fH es + OS + we Cmnk Sen (1) 
and, for each j = 1, 2,..,p, 


S(g)) = > Bisex 
k=1 


== Bye, + Bayes + --- + Base + --- + Baja * (2) 
Also, for each j = 1, 2, ...,D, 


(TS) (g,) = E vali 


= afi + Yale + oe t Yah + oe bh Yetta (3) 


164 / MATRICES 


Now, for each j = 1, 2, .. , p, we also have 
(7S)(g,) = T(S(g;)) 
= 7(81,€1 + Boyes + ... + Beste + -- + Basen) (by (2)) 
Bi,T(e1) + Ba,T(e2) + oe + BasT (x) 

+ oe + BusT (Cn) » (4) 
beceuse 7 is lirear. Each of the terms on the right-hand side of Equation 
(4) is, by Equation (1), a linear combination of the vectors fi, fi, .fmse 
Collecting the terms involving f,, we see that the coefficient of f, on the 
right-hand side of Equation (4) is 

Bi;%¢1 + Beste +... + Bastee «+ Bastin | 
= 58, =F 982) + see + se Bx aI ide 5 nba 


= 5 O..Pes : (3) 
k-1 


Comparing this with the ccefficient of f, on the right-hand side of 
Equation (3), we get 


I 


an 
Yo = D> Bas (6) 
k=} 


for everyi= 1,2,..,mandj=1,?,. ,p. 
Using this as motivation, we define the product of two matrices as 
follows. 


5.4.1 Definition Let A = (a,;) be an m xX n matrix end B = (f,,) an 
n X p matrix. Then the product AB is defined as the m x p 
matrix C = (y,,), where 


n 
Yu = pat 4x22 49 i= I, 2, ery m; J ae I, 2 cosy D. (7) 


In orcer to understand and use this Cefinition, we shall define the 
‘inner product’ of two vectors in V,. 


5.4.2 Definition Let u = (X, Xo, ..., X,) and v = (yy, Jo, -.-» Yn) be two 
vectors in V,. Then the inner product of « and v denoted by u : v is 
the scalar 

Us V = Xa + Naa t+ oe + Ann 
For example, if u = (1, 2, —3) and v = (0, —1, 2), thenu - v=1x0O 
+2 x (-1) + (-—3) xX 2= —8. . 
By this definition, the expression for y,; in Equation (7) becames 
\ = 1815 + OgBoy + ... F SinBas 
(Lope Aga, cveg Sin) * (Bay, Bay, «++» Bray) 
= {i-th row vector of A) - (j-th column vector of B) , (8) 
poth being considered vectcrs in Vy. 
So Definition 5 4.1] can be reworded as follows, 
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5.4.3 Definition (Reworded) Let A = (a,;) be an m xn matrix and 
= (6,,) an” X p matrix. Then the product AB is the m x p 
matrix C = (y;,), where y,; is the inner product of the i-th row 
vector of A and the j-th column vector of B, for i = 1,2, ...,m and 

j= 1,2, ..., p, both being treated like vectors in V,,. 


Example 5.11 Let 


[—3 1 2 | 

| PS de eel 
O —] 1 | 

A= ,B = 0 I |. 
1 0 —2 | 

| |_—2 3. 


L2 -—2 0_J 


Here A is a4 xX 3 matrix and B isa3 xX 2 matrix. So AB is the 4 x 2 
matrix 


Yu Yi2 | 
Yar Yoz 
| Yar Ysa 
LY¥a Ya 


where 
Yu = (Ist row of A) + (Ist column of B) 


=3x1+1x042 x (-—2)=-1 
Yig = (Ist row of A) « (2nd column of B) 
=3x(—-lh)+1x1+2x3=4 
Ya. = (2nd row of A) - (ist column of B) 
=Ox1i+(—1])xO+1 x (—2) = -2, 
and so on. Completing the calculations for all the y’s, we find that 


[(~-l 4°71 
—2 2 
AB = 
5 —7 
. L 2 —4 
12 Let 
Example 5 e x6 121 


ri+i -—i &% 
A =| | and B = 1 2 


(442 1—i 0] 
il a ae ae 


Here Ais a2 X 3 matrix and Bis a 3 x 2 matrix. So ABis the 2 x 2 
matrix 
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[~%. ya 
Lt ee] 
where a= (1+ 70—i(l) + 2™1—-) = 2-H 
yg == (1 + i)(1 — i) — (2) + 2i= 2 
= (4+/)04 (l—-d)I+ 01 —D=)-—i 
te = (4+ i(1—- i) + (1-24 06=7 — Si. 
["2 — 31 2 7] 

So AB = e 

Ll—i 7— Si_] 

5.4.4 Remark The discussion preceding Definition 5.4.1 proves that if 
t:L(V,) + Man 'S defined by 1(7) = the natural matrix of 7, 
then (7S) = +(7)s(S) for all 7, SE L(V,) and <7(AB) = +74(A) 
+ 1(B) for all A, BE Ma, a. 

In other words, the composition of transformations corresponds to 
matrix multiplication. 
Let us further analyse the process of matrix multiplication, namely, 


[Tsee Byy vor] 


oer Ma97 eos 
oe : | [3 ~] 
ee Bxj see = | ee Yu eee | 
Li: ¢ : : Lo: 


| eee Bans ees _] 


Here attention is fUcussed on the fuct that the ij-th element of AB is (i-th 
row of A) - (j-th column of B). But recall that we can form the inner 
product of two vectors only if both have the same number cf coordinates. 
In other words, in order that matrix multiplication be possible, we 
should have the number of entries in the i-th row of A equal to the 
number of entries in the j-th column of B, i.e. the number of columns of 
A should be the same as the number of rows of B. Thus, an mxn 
matrix A can be multiplied on the right by aq x p matrix Biff a = g. 
If n ~ q, then the product AB is not defined. 


Al x amatrix A is simply a row vector cf the form (a, a, ..., &,)s 
Ann X 1 matrix B is simply a column vector of the form (8), Bg, ---, By): 
The product AB of these two matrices is a 1 X 1 matrix [«,6, + of, 
+ wo. + &qf,}, Whose Only entry is nothing but a ecalar, which is the 
inner product of vectors 4 and B. 


In general, matrix multiplication is not commutative. For, if 


Or Ais ees Qk eee ig 
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i! of [~3 07 1 —274 (“1 —l 
A= | |, B= | c= |,D=| |. 
= I Li —-l_j 2 0 


2 1 | —1_j Lt 
then 
“3 oF r3 O7 
AB = | | and BA = | |. 
Le al [1 —1_) 
(~—-1 -—1) 
Hence, AB # BA. But we find that CD = | | = DC. 
L 1 -2_ 


On the other hand, we have the following theorem. 
5.4.5 Theorem (a) Matrix multiplication is associative, that is, (AB)C 
= A(BC), whenever cither side is defined. 
(b) Matrix multiplication is distributive over addition, that is, 
A(B + C) = AB-+ AC, whenever either side is defined. Also, 
(B + C)D = BD + CD, whenever either side is defined. 
The proof is left to the reader. Note the followin : 
(i) Onxn Any) = Onxp and 
A nxpOpxm == Onxm:- 
(ii) Tn, Anxm — Anxm and 
Agxmlm = Aaxm 
5 4.6 Definition If A and B are square matrices of the same order such 
that AB = J = BA, then B is called an inverse of A. 


Example 5.13 Let 


- 12 34 [ § —¢ —3 1 
4 01-2 B= 1 —2 |. 
L—1l 1 iL] L—-t # -tJ 
100 
Then AB={ 0 1 0/|=BA. 
0 0 1) 


Therefore, B is an inverse of A and A is an inverse of B. 
5.4.7 Theorem If an inverse of a matrix A exists, then it is unique. 


Proof: Suppose that B and C are two inverses of A. Then AB = I 
= BA and AC = I[=CA. Thus, we have 
C = CI = C(AB) 
== (CA)B (Theorem 5.4,5(a)) 
= IJB=B. 
Hence, B = C.§j 
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In view of this theorem, we speak of the (unique) inverse of A and 
denote it by A“. Whenever A ! exists, A is said to be invertible. 


By Theorem 5 4.7, it follows that if A7! is the inverse of A, then A is 
the inverse of A~!, ie. (47'!)! = A Both the matrices are therefore 
invertible. 


5.4.8 Theorem Ann x n matrix A is invertible iff the corresponding linear 
transformation T (via the standard bases) is nonsingular. 


Proof: Suppose A is invertible. Then there exists an nxn 
matrix B such that AB -- J, = BA. Let the linear transformation 
corresponding to B be S: V, -> V, Then, by Remark 5.4.4, 

t (AB) == t1(1,) = 1(BA) 
or t 1(A)t1(B) = t7U,) = 173(R)t7(A) 
or TS -= f= ST. 


So, by Theorem 4.7.2, T is nonsingular. 


Conversely, if T is nonsingular, then there exists a linear transfor- 
mation S$: V,— V, such that 7S = J -= ST. Therefore, by Remark 
5.4.4, (TS) = t() - (ST). If B is the natural matrix of S, we have 
AB =I, = BA. Hence, A is invertible. J 

For this reason, a square matrix that is invertible is called a non- 
Singular matrix. A square matrix that is not invertible is called a 
singular matrix. 

The foregoing ideas can be used in solving certain linear systems of 
equations. To do this, we first write the system in matrix form. 

Suppose that 


[yy Oi eee Qin ~] [ xy 7 
Oey Ogg ... Oey x3 
A= and x = ; = (X1 Nay 010) Xa)T 
Lyn ma «+> mn | | L. Xn _I 


Then Ax is the m x 1 matrix, i.e. a column vector with m entries : 
[OL yyXy Ht XyeXg + 2... + SinX, | 
SgiXy + AegXg f+ ... Tt Un, 
Ax = 


LOX + meXs +... + tng Xn 
Further, suppose we have m linear equations in 7 unknowns : 
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Ay Xy + LiaXo -b sain + LinXn ~= Vi 


BoyXy + GaeXy + ... + Santn = V2 


(9) 
LmiX, + SmeX2 4 ee + Smntn - Jm- 
The system (9) can be written in the matrix form 
[yy Sq oe Oy | | Mm | fo WM | 
Joy Fag ee Fon X2 | ye 
Ale | (1s) 
pt P| 
| ent Xn? eee ae { vn | L_ ym at 
or Ax --y, (11) 


where x 1s an unknown column vector and y the given column vector 
(Vis Yor -» > Yn). If the system has m equations in” unknowns, then A is 
a square matrix, and x and y aren X | matrices. 
Further, if 4A 1 inveitible, then A“! exists. Muluplying both sides of 
Equation (11) on the left by 47’, we get 
A Ax) = Avty 
or 


(A! A)x == ATly (Theorem 5.4.5) 
or [,x -- Ay 
or Ay: 


Problem Set 5.4 


1, Determine the mner product uv in the followmg cases : 
(a) u = (I, —1), v — (2, 3) 
(b) uw == (1, 2,3), v - (3,0, 2) 
(c) u=-(-1,1, 2, 4), v = (1, 2, —1, 1). 


2. Evaluate the following products : me 
mi 2 31 F 4 ~3 1 2 -W 7 = 
(a) } 4 0 1 2 (b) | 7 3 1 0 ; 
(3 0 0) L-lLJ LO 21 £4.) 
s mo i 24 - 
2 | 2 
(c) [2 —1 1 3) 7 (d) aj [3 l' 2) 
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1 i) 2 =] 
(e) | | | | . 
{i -lJ Li J 


3. For the given matrices A and B, determine the product AB or BA, 
whichever exists. 


0 17 
~~! 3 07 
[2 1 3_] 
Li 5.) 
‘ee 277 
-~1 3 04 | —] 
12 1 3] | x§ 7 
L 3 4_) 
[~1 5 77] 1237 


| 
sella di —1 0/,B= 012 
L 


0 2 1_] L3 7 OJ 
3 3) ri 23 4 54 
(d) A=| |,B=| | 
ae LO 13 0 1_j 
(~ 0 2 1°] 
Til 23 0 14 
3 5 7 
@4=|o 1010 ,_B= 
—1 1 0 
L3 01 2 5) 
{| 0O —2_) 
[1 i] ee i] 
() A=|_ |,B=| 
Li —1_) L—-i —I1 


4. Determine A“ for the given matrix A in each of the following : 


[~0 ri 24 Te py 
(a) A=| [(b) A=| | (€) A=| |,B #0 
Li oJ Lo 1 LB 0_J 


1 0 —275 
[a O07 

(d) A=| |,ay#O (ce) A=] 2 1 a. 
LB vy 

110 2) 


5. Compute 4’, A*, and A‘ for each given square matrix A. 
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pro 2397 -— 3017 
Ti 29 
(a) 0 2 1 (b) | }@ | 120 ‘ 
L.3 1_J 
L3 —I OJ tL 1 5 7) 
6. Determine all 2 <x 2 matrices that commute with 
~ 1 24 [0 17] “1 07 
(a) | | (b) | | (c) | | 
{ —l 0_J {1 —IJ LO 2_] 
177 
(d) | |. 
L.—1 0_J 
r 14] [~3 17] 1 07 
{2 1I_J L.2 —-l1_J {2 1] 
~~ 1 24 
~1 2 37) 
D = | |,£= | 1 0 |, solve the following matrix 
LO —1 IJ 
: L—-!l IL 
equations : 
(a) 3X — ABB=C (b) (BXD + AXD)E = C* 
(c) EXD = I. 
TA, O 4. 071 pu, O .. O 7 
0 A, eee 0 0 Lee ave 0 
8. A= . F : »B= 
{ 0 0 see A, _] |_0 0 wee a | 


Compute (a) AB (b) BA (c) A-', if it exists. 


9, Ann X n matrix A is said to be nilpotent if A" = 0 for some positive 
integer m. The smallest positive integer m, for which A" = 0, is 
called the degree of nilpotence of A. 


Check whether the following matrices are nilpotent. In the case 
of nilpotent matrices find the degree of nilpotence. 


co 0 0 07 mo 12 —17 
2 00 0 001 2 
(b) 

6, B 0 0 }000 1 

| 
Ly ¥% Ye OJ - LOO0O0 DO 


(a) 
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10. 


11. 


12. 


13. 


14. 


15. 


16. 


ri 5 ae rot -3 -47 
@fr2-|@]- 3 —4 1, 
L3 6 —3_] L. 1-3 4] 


if A and B are square matrices of the same order, then prove that 
(a) A®? — B*-=(A-- B)(A + B) iff AB = BA. 
(b) A?-+ 2AB + B? = (A 4 BY iff AB = BA. 


ee : 
f iy yn yg | 


Denote the matrix A = | a, 2 %23 


L_%3) %gq Ogg - | 


[Ay Aye | 
as A =: | | , where A,, == the matrix [o,,], Aig = [%2 %s], 
L.4o, Age | 
[yy | [hyn A, | 
Ag, = | |, Agy == | |. Similarly, define B, B,,, --- by 
{_% 3, J L.%je  &3g 5 


replacing «,, by 8,,. Then prove that 
[ Ay, cB B;, Ais 1 By | 
A+ B= | 
LAsr + Boy Ane + Boo! 
[AyBy + AB AB + ABs i 
and AB == | 
|_4o,By, + AreBry Aa Big + Age Bee! 
Ifx, ® are any scalars, then prove that A? — (« + B)A + aB/ 
=: (A — al)(A — BI), where A is any square matrix of order a and 
i=, 
If «,B are scalars such that A == 2B-+ #/, then prove that 
AB = BA. 


A square matrix A is said to be involutory if A* = I. Prove that the 


[1 a] [1 O71] 
matrices | | and | | are involutory for all scalars 
LO —I1_} Lae —I_]J 


a. 

Determine all 2 x 2 involutory matrices. 
Let +: L(V,) > Mas» be defined as in expression (1), § 5.2. Then 
prove that +~!(AB) == +71(A)c7(B) for all A, B E Ma, a. 


Let p(x) = a» + a,x + ... + 0x” be a polynomial of degree m, and 
A be a square matrix of order m Then the matrix polynomial p(A) 
is defined as p(A) =.a9f +- 4,A + ... + 4,A*, where J = Jy. 

If f(x) = 7x® — 3x + 5, g(x) = 3x3 — 2x? + Sx —1, 


17. 
18. 


19, 


20. 


21. 
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1 27 [("—1 17] 

A= | |,and B= | | , evaluate 
L—1 3_} tL I —2_j- 

(a) f(A) (b) g(A) (©) £8) (d) g(B) (e) S(2A4 + 3B) 
(f) 9(3A — 7B). 
Prove Theorem 5.4.5. 
Using matrix methods, solve the following systems of linear 
equations : 
(a) x+2y=3 (b) ax+fy=a (c) x— I= 

y=! Bx = 6 2x + y =2 

x-+- 22 = 3. 

If A and B are two nonsingular matrices of the same order, then 
prove that AB is nonsingular and (AB)-? — BuA7?. 


Prove that the set of the following eight matrices forms a group for 
matrix multiplication : 


1 07] fF —] U77 
[= | |, D, = |; 
{ 0 1_ | {| O -I1_J 
[- -i 07 [i 07 
D, = | |, Ds = | : |, 
L OQ i] | .0 -i_| 
r Oo 17 rO0 -17 
D, | |, D,r-- | |, 
{| —l 0_! L_1 0_| 
|" O af aa r 0 1] 
D, = | l; D, = | - 
| —I Q_| | a 0 | 


Wrile the multiplic ition tab'e of the group. 
True orf alse ? 


["a 5} i -a ie [("—a® +b’ ac + — 
a) | | = | , 
: 'ecd3;toe 4a_) | —ac+ bd c+ d*_| 
(b) If AB = J, then A |s invertible. 


(c) If A and B ate square matrices of the same order, then 
AB = BA. 


(d) The system of two equations 2x + 3y = land 4x 4- 6y, = 2 


cannot be solved by the method discussed in this article. 


(e) Let A be 2 x 3 and Bbe3 x 2 matrices. Further, let C be 


2 x 2 and Dbe3 x 3 matrices. Then 
(i) AB is defined but not BA. 
(ii) AB and BA are both defined. 
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(iii) BC is defined but not CB. 
(iv) DA is defined but not AD. 
(f) For every integer m > I, there exists a nonzeronm X n matrix 
which is nilpotent. 


(g) For every integer » > 0, there exists a nonzero” X n matrix 
which is nilpotent. 


5.5 RANK AND NULLITY OF A MATRIX 


We have seen that every m x m matrix A corresponds to a unique 
linear transformation 7: V, -> V,,, where we have agreed to use the 
standard bases in both spaces. We shall now show that the value of T at 
an arbitrary vector x is just the effect of matrix multiplication of A by x 
in that order. 

Let A =: (%5;)mxn- Let the standard bases in V, and V,, be {e,, 
Cy, ---> Cn} and { fi. fo, .--. Sm}, Tespectively. If x = (x1, Xg. ..., X,) is an 
arbitrary element of V,, then x = x,e, +- Xge— +... + Xn@n Let 
T:V,-> Vm be the linear transformation associated with A. Then, for 
each j = 1,2, .., 4, 

T(e,) = Osi a te; fe a sae Kins Son a, (a1), Ro iy sory Ons) » (1) 


because { /1, fo, ...» fm} 18 the standard basis for V,,. Writing these 7(e,;)’s 
as column vectors, we get 


T(x) == T(x1¢, + X22 +... + Xnen) = XT (ey) + X2T (eg) + ... + XaT (Cn) 


oe | [Oy a [tn | 
Or | er | | Cen 
=x| ae a (2) 
| O%my L_ & met L &nn J 


[yy Xy te @ygXq -b ww. bt CnX_, | 


HoyXy + AegXqg + woo + SgnXn 


| 
| - 
Lon ¥y 2 Amar + eve + Lmnrn —! 
ot er  ) 
oT Leo eee len Xs 


= Ax. (3) 


Lip Sopp cee un | LX) 
Thus, the vector Z(x) is obtained by multiplying the matrix A by the 
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column vector x == (x,, X33 ---, X,)7 in that order. In this sense there- 
fore a matrix can be identified with the linear transformation it represents. 
In other words, if A is an m xX n matrix, then the corresponding linear 
transformation 7: V,, -> V,, represents the operation of matrix multipli- 


cation of A by vectors of the space V, (assuming that we use standard 
bases throughout). 


Let A be an m X n matrix («,,). Instead of talking of the linear 
transformation T associated with A, we talk cf A itself as the hrear 
transformation, the understanding being that the value of the linear trans- 
formation A at x = (X,. Xo, ..., Xn)" is just the matrix product Ax. 


§.5.1 Definition Zhe range, kerne!, rank, and nullity of a matrix A are 


defined as the range. kernel, rank, ard nullity of the linear 
transfurmation A. 


Range of A_ The range of A: V,-- V,, is the set of all vectors of the 
form Ax € V,,,x € V,. For A = (4,,), it is the set of all column 
vectors of the form 


[ y%y + OX. + .-. T einrn | 
hoy Xy 4 XeeXy fF + Go4Xp | 


Ls 
t 


| ny Xy + AnaXg ae Canty ol 


[oy] i Org | Oin | 
%1 | %22 Cen 
1€. ] + X, + ..4 Xn i 
® : | 
| 
a |_ Ome = | —~Fmnn | 


which are just linear combinations of the column vectors of A. 
Obviously, column vectors of A are vectors of V,,. ‘Thus, we have the 
following result : 

The range of anm x_n matrix is the span of its column vectors. 
Rank of A The rank of a matrix A is the dimension of the range of A, 
i.e. the span of column vectors of A. This shows that the rank of A is the 
maximum number of linearly independent column vectors of A. 


Example 5.14 Let 


[—3 1 27 
2 —1 0 
A= 
l 1 1 
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The range of A is [(3, 2, 1, 0), (1, — 1, 1, 1), (2, 0, 1, 2)]. The rank of A 
is 3, since the three vectors listed are LI. 


Example 5.15 Let 
[~3 1 407 


A=} 0 22 0 


i1 -1 0 04 
We have R(A) — [(3, 0, 1), C1, 2, =); (4, 2, U), (0, 0, 0)} = [(3, 0, 1), 
(1, 2, —1), (4, 2, 0)] = [(3, 0, 1), (1,2, —1)], since (4, 2, 0) = (3, 0, 1) 
+ (1, 2, —1). The rank of A is 2, because (3, 0, 1) and (1, 2, —1) are LI. 
Kernel of A The kernel of A is the set of all vectors x € V,, such that 
Ax = 0.41: 
Nullity of A The nullity of A is the dimension of the kernel of A. 
Example 5.16 Let 


Tr 2 14 
A=:| -1 2 
L 3 0 


This is a linear transformation from V, to Vs. We have 


| 2 170 x47 [(~— 2x, + x2 1 [~ 0 
p12] | =: | —x, + 2x, -| 0 ; 


L_ 3 OJ Lx», _JI { 3x, _I | Oo J 
Thus, Ax = 0, x, implies 
2X; + X, = 0, —x, + 2x, = 0, 3x, = 0. 
This gives x, = 0 = x». Therefore, the kernel of A is {0} and the nullity 
of A is 0. 
Example 5.17 Consider the matrix of Example 5.15. We have 


["x, ] [—3x, + X%_ + 4x, | 
[3 1 40) 


xy | 


| 
0 220 | ex | 
Xs | 2X_ + 2X, 
Li ~—1 0 OJ | 
L»~%t Lx x, _ 
Thus, Ax = 0 implies 3x, + x, + 4x3 = 0, 2x, + 2x, = 0, x, — x, = 0. 
This gives x, = x, = —x,. So the kernel of A is the set of all vectors 


of the form (x1, X1. —X:, X,) = xi(I, 1, —1,0) + x,(0,0,0,1). It is 
therefore the span [(1, 1, —1, 0), (0, 0, 0, 1)J. So the nullity of A is 2. 

In Examples 5.14-5.17 rank + nullity = dimension or V,. This 
theorem, which is true for linear transformations between finite-dimen- 
sional vector spaces, is also true for matrices, because of the identification 
of matrices as linear transformations in the above discussion. 


5.5 RANK AND NULLITY OF A MATRIX / 177 


Recall that a linear transformation from V, to V,, is one-one iff it is 
onto. So ann X n matrix A will be a one-one linear transformation iff 
its range is the entire space, te. iff its rank is nm. This means that the 
maximum number of linearly independent column vectors 1s 7. If other 
words, the column vectors of A are LI. Since the foregoing argument is 
reversible, we have the following theorem. 


5.5.2 Theorem A square matrix is nonsingular iff its column vectors 
are LI. 


Example 5.18 Let 


~~ 10774 
A == 1 2 3 
L -! 1 O_) 


The range of A 1s [(1, 1, -1!), (0, 2,1), (1, 3, 0))]. For the kernel of A, 
consider 


r bom rat (07 


| 1 2 3 i . 
1-1 103 Lx Lod 


This gives x, + x; =90, x, + 2x, + 3x, = 0, —x, 4 X%, = 0. Solving 
these equations, we get x, = --X3,1, =X, So the kernel of A is 
[(d,1,—1l)] Therefore, the nullity of A is 1. So the rank of A Is 
31.2 2, 

The same result 1s obtained by inspecting the range of A. The range 
of A is [(1, 1, — 1), (0, 2, 1)], because (1, 3,0) = (1,1, —1) + (, 2, 1). 
Hence, the matrix A is singular. 


Example 5 19 Let 


[~2 ft —1) 
es 


eh, eal: <0 


The range of A is [(2, 1, 1), (1, 2, — 1), (--1, 9, 1)]. The rank of A is 3, 
because we can easily check that these three vectors are L1. Hence, A Is 
nonsingular. This can also be arrived at by showing that the kernel of A 


is {0}. 
ria | 
Example 520 Prove that A = | ‘ aA is nonsingular and find its 
L 


inverse. . 
The column vectors (1, 0)? and (2, IT are Li. Therefore, the matrix 
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a 
is nonsingular. Assume that the inverse of A is | - Then 
Ly 6_] 


e m1 297 Fa BT fF! OF 


| = , 
LO 1jLy 83 LO ll 
pears 6+2897 (fl 07 


ae § J LO Il 
So «2ft2y=1, 8+28=0, y=0, = 1, which gives « =|, 
= —2, y= 0,3 = 1. It is easily seen that 

fr do-27°]) fl 29 fl 24 | =e (“1 074 

a tj a | Lo {_§} L.0 lJ r : 
Hence, 


1.€. 


ft —27| 
At =| ze 
|. 0 )_| 
Example 5 21 Find the inverse of the matrix 
m~ | 2 37) 
A = 0 1 2 
sed 1 14 


The reader can check that the column vectors of A arc LI and so 4 is 
nonsingular. To find the inverse, we solve the niatrix equation 
12 371 [a w a) [I 0 07) 


oe B, Be By |} ~] O 1 O 


rc 
| 
| 
L-1 1 ldo tm ve vst LOO 1 
We get n ne equations in nine unknowns. Solving, we get 
r+ -b -aT 
A“ = 1 ~—2 1 


Alternate methods (which are more powerful) of finding the iverse of 
a nonsingular matrix will be described in § 5.9. 


Problem Set 5.5 
1. Find the range, kernel, rank, and nullity of the following matrices : 
~~ 13 24 2 O14 
| -l —1 27 | 
(a) | —1 7 2 } (b) | l(c) | 7 1 2 
L3 -2 5. 
10 1 (3 —! IQ 


2. 


3 
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2 3 aed Tl —-1 1 07 
0 3-121) 2 3-1] 
(d) (e) 
1-3 2 4 3 1 5 20 
12 303 04 (0 0 144 
Pep 4 3 
(f) 3 1-1} 
122 44 


Prove that the following matrices are nonsingular and find their 
Inverses : 


(too; | ame 
~- 1 29 | | 
(a) | | (b) 2 1! Of] (co) | 3 0 ] | 
L—I 0_J 
(3 4 21 [_O 1 1 J 
a | 1 2 37 (2211 | 
! 
2 1 1 | 0 2 147 
(d) (e) ; 
| 3 ] ~—!] (001 1 
| 1 +] 0_| 10 6 | O03 


Find the values of « and 8 for which the following matrix is inverti- 
ble. Find the inverse when it exists 


Ta 8 O77 
On Bl. 


LB O a] 


4. Prove the following : 


5. 


(a) If two rows of a matrix are interchanged, then the rank does 
not change 

(b) Ifa row of a matrix 1s multiplied by a nonzero scalar, then the 
rank does not change. 


True or false ? 


(a) The range and kernel of a square matrix are of the same 
dimension. ‘ 

(b) There exists a 7 x 12 matrix whose rank is 10. 

(c) If two columns of a matrix are interchanged, then the rank does 
not change. 

(d) If a column of a matrix is multiplied by a nonzero scalar, then 
the rank does not change, 
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(e) The rank of an m x n matrix having r rows of only zeros is 
less than or equal tom — r. 


rl23 44 Til 0 07 
A={|0Q0 00 0],B=j|2 0 0 ; 
L000 0_J L4 0 O_J 


(f) The kernel of A is 2-dimensional. 
(g) The kernel of B is 2-dimensional. 
(h) The ranks of A and B are the same 


5.6 TRANSPOSE OF A MATRIX AND SPECIAL 
TYPES OF MATRICES 


In this article the matrices involved ‘may be considered real or complex. 

Let A be anm X mn matrix («,,). Writing the rows of A as columns 
(and therefore the columns of A as rows). we get a new matrix called the 
transpose of A, which is denoted by A’. Actually, the ij-th element of 
A’ is a,;, as can be seen from the details of the following entries ° 


[Oy his seo Xs ave Ain 7} ron Qo) eee a eee Ong ~] 
oy GAgg ..- Ay, 22s Loy, | &%yg gq ..- Hyp «-- Ang 
| 
A= | 
O51 X32 Kos On Kye, Ha, vee Gog wee Ts 
: : : 
| | 
L_ Gm Omg oe. me e+ Smn—| Loin Gon oe. yy 00. Cent 


Clearly, A’ is an 1 X m matrix whose j-th element ts a,,, the ji-th 
element of A. It follows immediately from the definition of transpose that 
IT = I, and OF xn = Onxm 
5.6.1 Theorem /f A and B are two m X n matrices, then 

(a) (A+ B)T = AT + BY, 

(b) (aA)? = «Al, and 

(c) (AT = A 

The proof is straightforward and left to the reader. 

5.6.2 Theorem Jf A is an m Xn matrix and Bis ann X p matrix, then 

(AB)? = BAT. 

Priof: First, note that AB is defined and is an m x p matrix. So 
(AB) isapxa matrix. Again, Ar is an » X m matrix and BT is a 
p X nmatrix. Therefore, we have p X m matrices on both sides of the 
equality in the theorem and so the equality is meaningful. 


5.6 TRANSPOSE OF A MATRIX / 181 


To prove that the equality holds, it suffices to prove that the ij-th 
element of (AB)? is equal to the ij-th element of BTAT, Let A = (as)mxa 
and B = (B;,)axy. Then AT = (a/;)axm and BT =: (B;,)oxn, Where acy 
= ay and = B,, == B;;. The ij-th element of BTAT is 


n jee n R 
ZByey = DBree = 2 OnBa, 
k-=1 k=} k=1 
which is the ji-th element of AB and hence the ij-th element of (AB)’. 
Thus, (AB)? - BTA. 


5.6.3 Theorem /f A is a nonsinguiar square matrix, then A’ is also non- 
singular and (A) == (A™)!. 
Proof: Since A is nonsingular, there exists a matrix B such that 
AB = I = BA. Therefore, 
(AB)? = JT =: (BA)T. 
This gives B7A? == J -= A BT’. Therefore, A has the inverse, namely, 
BT, and (AT)"! = BT = (A7})', because B= A’. 


5.6.4 Corollary The:columns of a square matrix A are LI iff its rows 
are LI. 


Proof: Columns of A are Lt A is nonsingular (Theorem 5.5.2) 
« A is nonsingular (Theorem 5.6.3) ¢ columns of AT are LI (Theorem 
5.5.2) « rows of A are LI (definition of A’). §j 


We shall prove in Theorem 5.7.5 that in any matrix, not necessarily 
square, the maximum number of linearly independent columns is the same 
as the maximum number of linearly independent rows. 


Before we conclude this article let us familiarize ourselves with certain 
special types of matrices. 


A square matrix of the form 
ra, 0 0..0 077] 


0 A 0 ..0 0 
0 0 A... 0 0 


LO 0 0.4.0 Ag] 


is called a diagonal matrix. In other words, A = (az)nxn iS 8 diagonal 
matrix if «,; = 0 whenever i 4 j, i.e. ay = Ady. 


A square matrix of the form 
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A 0... 07 
0-A... 0 


LO 0... ALJ 


is called a scalar matrix. In other words, A = (.;)nxn is a SCalar matrix 
if Ly = Ab, for a fixed scalar A. 
A square matrix of the form 


[O11 Og Og... Cin | 
QO = dyg ag «0. on 


0 0 AZgq .-. Agn 


LO 0 OO. ... dan_l 
is called an upper triangular matrix. In other words, A = (ci)axn iS an 
upper triangular matrix if «,; = 0 whenever i > /. 
A square matrix of the form 


(a, 9 O 7] 


20 
1 % O +. 0 
ee 


x. ee Oe mare Pes | 
is called a lower triangular matrix. In other words, A = (¢;,)axn iS a lower 
triangular matrix if «,, = O whenever i < j. 

A square matrix A is said to be idempotent if A? = A. 

A square matrix 4 is said to be symmetric if A = AT, i.e. ay = ay, for 
ail i, j. 

A square matrix A is said to be skew-symmetric if A= —A , i.e. 
Ay == —- Ay for all i, j. 


If A = (ay;)mxny the matrix B= (&s)mxn. Where the bar denotes 
complex conjugation, is called the conjugate of A. It is denoted by A. 

The matrix (A)" is called the transposed conjugate of A. It is denoted 
by A*. Obviously, (A)? = (A). 

A matrix A is said to be Hermitian if A = A*, i.e. if ay = %%. It is 
said to be skew-Hermitian if A = —A*, i.e. a = —%,. For example, 
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r 0 FT - lo 1-9 
| { and | | are Hermitian matrices 
L—é# 0.) Li+i 2 _J 

ro im 


and | | is a skew-Hermitian matrix. 
Li 0_J 


From these definitions of special matrices, we get the following results : 
(1) The product of two diagonal matrices of the same order n is again 
a diagonal matrix of order n and 


TA, 0... 07 Tuy O -. 077 Taw, O .. 0 7 
lo Ae ... O 0 pw. 0 0 Aves 0 


| 
| 
| | 
| 
| 
LO O .. Aw} LO O .. Bat LO QO 4. Aye, 

(ii) Any two diagonal matrices of the same order commute with each 
other. 

(iii) A diagonal matrix is nonsingular iff none of the diagonal entries 1s 
Zero. 

(iv) The inverse of the diagonal matrix 


Da, 0 « OTF [try OO O07 
0» - 0 0 Ip, . 0 


(0 O .. A} 6 6LL Oo) UO IP y_t 
A, #0, i= 1,2,..., 0. 
(v) The transpose of an upper (lower) triangular matrix 1s lower 
(upper) triangular. 
(vi) In a skew-symmetric matrix all the diagonal entries are zero. 
(vii) In a Hermitian matrix all the diagonal elements are real. 
(viii) Multiplication of a matrix A by the scalar matrix AJ is equivalent to 
multiplication of A by the scalar A. 


Problem Set 5.6 


1. Prove Theorem 5.6.1. 


-— 12 37 a ee ae 
rl oo —17 
2 A=|—-1 1 2|,B=] C=} 1 1 |, 
L3 —1 24 


3 1 —2_]} L.—2 3_] 
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10. 


it. 


Ti -—14 f~-1 1 04 


p=| 2 0 |e 2 0 i 
L3 2) L111 3 


For these matrices, evaluate the following : 

(a) AT (b) BT (c) ABT (d) (CB)T (e) (AC) (fy BAT 
(g) CTBT (h) B+opT (i) (C+D). 
For the matrices in Problem 2, verify the following : 

(a) (A+ E\ = AT+ ET (b) {D(C + BI)}T = (CT + BD 
(c) (C+ 5D)’ = 2CT +4 5DT (d) (AC)T = CTAT 

(e) (CDT) = DCT. 
For m X n matrices A, B, and C, prove that 

(a) (ABT)T = BAT (b) (ATB)T = BTA 

(c) ((A + B)CT)T = C(AT + BT) (d) ((A + B)TC)? = CT(A 4- B) 
Determine A* for the matrix A in the following : 


ed ro oe 


(a) | | | 
Exel ead Dee L2+i 144) 3-—2J 
P2+3i 2-97 ee ee ee oe 

@ | 1-2 2-2) | (4) | 2-i i =] 
L344 2+ 7 _J Li+téie 247 34+ 2i_J 

[ah g) 


-IfA= | hb f ana X = (x, y, 2), evaluate XAXT. 


Leffel] 


If A is an m X nm matrix with complex entries such that AA* = 0, 
prove that A = A = 0. 


If A and B are square matrices of the same order and A is symmetric, 
prove that B'AB is also symmetric. 


(a) Prove that a triangular matrix whose leading diagonal entries are 
all zeros is nilpotent. 
(b) Determine a matrix that is both upper and lower triangular. 
Let A be a square matrix. Then prove that 
(a) A-+ A* is Hermitian. 
(b) A — A® is skew-Hermitian. 
(a) Prove that every square matrix can be expressed as the sum of 
a Hermitian and a skew-Hermitian matrix, 
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(b) Prove that every square matrix can be expressed as the sum of 
a symmetric and a skew-symmetric matrix. 


12. Prove that the set of all » x m diagonal matrices is a subspace of 
Mas n: 


13. Prove that the set of all x 7 invertible diagonal matrices is a group 
under multiplication. 
14. True or false ? 
(a) The set of all » x m diagonal matrices is a group under multi- 
plication. 
(b) If A 1s involutory, then its transpose is also involutory. (A is 
involutory means A? = J.) 
[— 0 1 27] 


(c) The matrix! - 1 0 3 | 1s skew-symmetric. 


_—-2 —3 I1_] 
(d) Every symmetric matrix is Hermitian. 
(ec) A nonzero idempotent matrix 1s not nilpotent. 
(f) An idempotent matrix A 1s singular unless A = J. 


5.7 ELEMENTARY ROW OPERATIONS 


In this article we shall study certain Operations on a matrix that help us 
to determine i!s rank. First, we start with the familiar method of solving 
a system of simultaneous linear equations in three unknowns. 

Two systems of (simultaneous) linear equations are said to be equival- 
ent (in symbols, ¢ ) if they have the same set of solutions. 

Let us solve the system 

2x—3y+ z=-l 
3x +Oy+ z— 6. (A) 
x + 2y—2z = —1 
Interchanging the first and third equations, we get the system 


x-+2y —2z=-1 (El) 

3x ++ Oy + z=" 6 (E2) 

2x -—-3y+ z=-—l1 (E3) 

(El): x+2y—2z= —I1 (£4) 

(El) x (—3) + (£2): Or—6y+7z= 9 (E5) 

(El) x (—2) + (B3): Ox —Ty+5z= 1 (E6) 
4 

(Ei): x+2y—2z=—1 (E7) 

(ES) x (—4): Ox+ y— Gz = —} (E8) 

(E6): Ox—7T7y+5z= 1 (E9) 
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re 
(E7): x+2y— 2z= —1 (E10) 
(E8): Ox+ y— jz= —} (E11) 
(E8) x (7) + (E9) Ox + Oy — ifz = —1P (E12) 
4 
(E10): x+2y— 2z2 = —1 (E13) 
(Ell) Ox+ y- jz= —-} (E14) 
(E12) x (-i%5) Ox +0y+ z= 3 (E15) 
= (E13): Ix + 2y— 2z= -1 (E16) 
(E15) x (8) + (E14): Ox+1y+ 0z = (E17) 
(E15): Ox+- Oy + Iz== 3 (E18) 
rd 
(E17) x (—2) + (E16) Ix + 0p — 22 = —5 (E19) 


(FI7): Ox+ ly + Oz= 2 (E20) 


(E18) Ox+ 0y+ 1z 3 (E21) 
= 
(E21) x (2) + (E19) ‘Ix + Oy + Oz= 1 
(E20) Ox+ly+ Oz= 2 (B) 
(E21) Ox+0v+ Iz= 3 


which gives x = !, y = 2, and z = 3. 

It can be seen that throughout we have worked with only the coeffi- 
cients in the equations and the numbers on the right-hand side. The pre- 
sence of the symbols x, y, and z and the sign of equality does not at all 
affect the working. Now, deleting the symbols x, y, and z and the sign of 
equality from the pattern, which otherwise remains unchanged, we shall 
write only the numbers involved in the form of a matrix A. Repeating 
the foregoing sequence of steps, we get the following sequence of matrices, 
where the symbol ~ is an analogue of the symbol «, and the letters r,. 7, 
and r, stand respectively for row 1, row 2, and row 3. Further, r, + kr, 
means ‘add k times the j-th row vector to the i-th row vector’. We have 


F2—-3 1-] ml 2-2-1754 
~~ 
matrix A =| 3 0 1 £6 | interchange| 3 O 1 6 | 
r, and r, 
Li 2-2 —1_J L2-—-3 1-1.) 
—~ pi 2-2 -19 ri 2-2 -17 
Vs 1 Com 0-6 7 9|4rx(-4)!0 1-7 -} | 
mt(—Inio-7 5 14 10-7 £ lJ 
mi 2 2 -174 Ti 2-2 —14 
md ae — rw Se oe 
ry t+ irs a i rT, X (—7is) i ¢ -t 


Lo 0 — —4P_) 00 1 3_] 
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rl 2 —2 -—14 “i 0 —2 579 

ro + 6ls = O02) r+ (—2)rz 01 02 
{0 QO l 3.) LO 0 1 3_J 
rt 00 14 


r+ 2r,| 9 1 0 2 | ~ matrix B. 
10 01 31 


The systems (A) and (B) have the same soluticn, because one has been 
obtained fiom the other by certain operations that do not affect the 
solution set. The same operations when ferformed on the rows of matrix 
A produce matrix B. These aperations are called elementary row 
operations. They are of three types: 


Type I Interchanging two rows. 
Type IT Multiplying a row by a nonzero scalar. 
Type III Adding to a row a scalar-times another row. 


57.1 Definition When a matrix A is subjected to a finite number of 
elementary row operations, the resulting matrix B is said to be 
row-equivalent to A. We write this as B ~ A. 

A monient’s thought will show that ~ is an equivalence relation. 

§.7.2 Definition The row rank of a matrix A is the maximum number of 

linearly independent row vectors of A. 


5.7.3 Remark In this sense the rank of a matrix A, defined in § 5.5, must 
be called the column rank of A. But ultimately (see Theorem 5.7.5) 


1 0 20 2 0 0 0 0 


ono oOo oOo Ace oe SBS © 


2 
0 
0 
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we shall prove that for any matrix A the column rank is equal to the 
row rank; so we can afford to call both of them simply ‘rank*. Till 
then, we shall have to distinguish between the row rank defined in 
5.7.2 and the rank (= column rank) defined in § 5.5. 


The aforesaid process of obtaining matrix B from matrix A is called 
the process of row reduction. In practice we usually aim at getting Bin a 
standard form called row-reduced echelon form. 


Consider the following 7 x 11 matrix and the ‘stairs’ or ‘steps’ marked 
therein : 


Such a matrix is said to be in row-reduced echelon form. We shall 
now give its precise definition. 


5.7.4 Definition A matrix is said to be in row-1educed echelon form if it 
satisfies the following criteria : 


(a) The first nonzero entry in each nonzero row is 1. 


(b) If a column contains the first nonzero entry of any row, then 
every other entry in that column is zero. 


(c) The zero rows (i.e. rows containing only Zeros) occur below all 
the nonzero rows. 


(d) Let there be r nonzero rows. If the first nonzero entry of the 
i-th row occurs in column k, (! = 1, 2,...,1r), then k, < k, 
ee Kee 


Draw horizontal and vertical partition lines such that below and left 
of these lines there are only zeros and such that at the point where the 
vertical line is followed by a horizontal line there are 1’s, namely, the first 
nonzero entries of nonzero rows. These turning points are called steps. 
See the foregoing 7 X 11 matrix, where there are s'x steps. 


We now state the main theorem of this article. 


5.7.5 Theorem (a) The sow rank and column rank of a matrix A are the 
same. In other words, the maximum number of linearly independent 
row vectors is equal to the maximum number of linearly independent 
column vectors and is equal to the rank of the matrix. 


(b) The rank of a matrix A is the number of nonzero rows in its row- 
reduced echelon form. 
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We shall prove this theorem by establishing a succession of lemmas. 
The sequence of proof can be easily understood from F'gure 5.1 : 


Row rank of A Column rank of A 


@ eo 
~ é 
> w 
o 
e|| lz 
Ee £ 
s ® 
‘ ~t 
a a 
Row rank of B REET Column rank of B 
e by Lerma 5710 
=, a? 
% 
SS) 
& 
o3 2 
> > 
Number of = Number of 
nonzero rows steps 
of B in B 


A. Given matrix 


B: Row reduced echelon form of A (Lemma 5.7 6) 


Fig $-t 
FIGURE 5.1 
5.7.6 Lemma Every matrix A is row-equivalent to a row-reduced echelon 
matrix, 


In other words, every matrix can be reduced to the row-reduced 
echelon form by a finite sequence of elementary row operations. 

We shall omit the proof of this lemma, as careful scrutiny of the 
process of row reduction will convince the reader that this lemma is true. 


5.7.7 Lemma /f a matrix is in the row-reduced cchelon form, its row rank 
is the number of nonzero rov's in it. 
The proof is left to the reader. 


5.7.8 Lemma The row rank of a matrix A is equal to the row rank of the 
row-reduced echelon matrix B, obtained from A. 


Proof: B has been obtained from A by a finite sequence of 
elementary row operations. We shall show that these row operations do 
not affect the row rank of A. It is clear that the row operations of type 
I and type II do not alter the row rank (see Problem 4, Prablem Set 5.5). 
It is therefore enough to prove that an elementary row operation of type 
III does not change the max‘mum number of linearly independent row 
vectors. Suppose we add «-times a row vector v, to «nother row vector 
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v,. Let the other row vectors be v5, Vg, -- » Ym- Examine the two sets of 


vectors 
P — {v,, Vo, eery Vin} and QO — {vy, Vo + aN, Vg» eorg Vn} * 


It can be easily checked that (1) if P is Li, then Q 1s also Lt and (ii) if P is 

LD, then Q is LD. This shows that a type III operation does not affect the 

maximum number of linearly independent row vectors, and so the row 

rank is unaffected by such an operation (see Problem 9). § 

5.7.9 Lemma Jf a matrix is in the row-reduced echelon form, then its 
(column) rank is the number of ‘steps’ in it. 


Froof: Let the number of steps be p. Every column that occurs 
before the first step is a zero vector, and every row that occurs after the 
last step is also a zero vector. So the nonzero column vectors can be 
considered vectors in V,. Therefore, the column rank is less than or equal 
to p. On the other hand each step contributes one nonzero column 
vector. The set of these column vectors is LI. This means the column 
rank is greater than or equal to p. Thus, the column rank is p. 


5.7.10 Lemma Jf a matrix is in the row-reducced echelon form, then its 
(column) rank is equal to its row rank, 


Proof: Note that the number of steps in such a matrix is equal to 
the number of nonzero rows. Using Lemmas 5.7.7 and 5.7.9, we find that 
its (column) rank is the number Of steps in it, i.e. the number of nonzero 
rows, i.e. its row rank. 

5.7.11 Lemma The (column) rank of a matrix A is equal to the (column) 

rank of the row-reduced «chelon matrix B, obtained from A. 


Proof: To facilitate understanding cf this lemma, we shall prove 
it for a matrix cf order 3 x 4. By using proper notations, the same 
proof can be extended to any m X nm matrix. 

We have only to prove that the thiee types of elementary row 
operations do not affect the column iank. The fact that types I and II 
opcrations do not affect the column rank is easy tO prove and is left to the 
reader. To prove that a type III operation does not affect the column 


rank, consider the matrix 
[ Oy, Gyg yy A, | 


P= Bo, Xo eg og 


L 0g, Age Ogg Oyq_I 
Let us petform a type III operation on P, namely, let us add «-times row 
3 to row 2. The resulting matrix Q will be 


[~ yy X19 1g eS] 


Oe, + aay, Gey + OAXgs Aas + Migs Oey + Mtg, 


Q —_ 
[. Oy Age Ogg teed 
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Suppose the column tank of P is 3 (any other value of the rank can be 
handled analogously). Then in P there exist three linearly independent 
column vectors and every four column vectors are LD. We shall prove 
that the same phenomenon occurs in Q also. 


Let the three linearly independent column vectors of P be the first three 
(if they are any other three, they can be brought to the first three positions 
without affecting the argument). Let us call them C,, C,, and C3: 

If F,, F,, and F, are the first three column vectors of Q, then the vector 
equation 8, F, + 8.F, + B3F, = 0 gives 

Bitar + Boo, + Bja,, = 0 
Bi(%x, + acg1) + Bolags “+. 9952) + Ba(v25 +- wags) = 0 
Bits, + Bixge + Byxgg = 0. 

Adding ( —«)-times the third equation to the second equation, we get 

the equivalent system 

Bitar + Botye + B30)5 = 0 

Biter + Brees + Byte, = O 

Bias + Batge + Byxgg = 0. 
This system is nothing but the vector equation 6,C, + 6,C, + 6,C, = 
0. Since C,, C,, and C, are Lt, we get 8B, = 0 = 6, = B,. Thus, F, K, 
and F; are LI. 

Again, we prove that when C,, C,, C3, and C, arc Lp, then automati- 
cally F,, F,, F;, and’ F, are also Lp. 

The vector equation 8,F, + B.F> -| 83F; | BF, = 0 gives 

Bitar + Buoys -t Byes + Batag = 
> By(may + axog3) + Bilton + 2792) + Balees | aags) + By(aeq + aag4) = O 
Bizsr + Bo7s2 —- Batss + Bytag = 0. 

Adding (—«)-times the third equation to the second equation, we get 
an equivalent system which is nothing but the vector equation B,C, + 8,C; 
+ B,C, + B,C, = 0. 

Since C,, C,, C;, and C, are Lp, at least one B is not zero. Hence, Fy, 
F,, F;, and F, are Lp. 


Thus, we see that the type III operation does not affect the column 
rank of matrix P. 


Proof of Theorem 5.7.5: (a) Let B be the row-reduced echelon 

form of A. Then 

row rank of A = row rank of B (Lemma 5.7.8) 
= column rank of B (Lemma 5.7.10) 
= column rank of A (Lemma 5.7.11). 
= column rank of A (Remark 5.7.3) 
row rank of A (part (a) of this theorem) 
row rank of B (Lemma 5.7.8) 
number of nonzero rows in B (Lemma 5.7.7). 


(b) Rank of A 


Wi 
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5.7.12 Corollary Ann xX n matrix A is nonsingular iff its row-1 educed 

echelon form is f,,. 

Proof: Let the row-reduced echelon form be /,. Clearly, its 
column vectors are Lr. So the rank of J, ism. Hence, by Lemma 5.7.11, 
the column rank of A is 7, i.e. column vectors of A are Lt. Therefore, by 
Theorem 5.5.2, A is nonsingular. 

Conversely, let A be nonsingular. So the rank of A is 7. Therefore, 
the row-reducéd echelon form B of A will have 7 linearly independent 
column vectors (Lemma 5.7.11). Since the number of columns in B is a, 


it follows that B = J,. §j 
Example 522 Determine the rank of the matrix 


f~ 12-1 go 


-1 3° 0 —4| 


21 3 2 | 


( 11 Lt -14 


f t2 -—-1 OF rl 2-1 O74 

pes —-!1 3 oO —4 ret ts 0 5S -l —4 
le — LI, 

24 3 -2/ 8 77¥) 0-3) 5 ~2 

{| 1 1 1 —Il_] LO —!1l 2 —I1_} 

[1 2 —-1l 01 i 2 -l 07 

inter- 0-1 2-1 a 0 1 -—2 ] 


changing = _» {re X (—)) 
ynandr, | 2 72 3 —2 7% 0-3 5 -2 


LO 5 —I —4_} Lo 5 —l —44 
eh. 2 =f 24 rio2--1 oF 
~ lL 2 1 _ 0 1-2 1 
eae 0 o -1 1/%t%) qo ot 1 
ie 0 9 —9] L.0 0 oO, 
rl o2-ih O71 I 9 -—1N 
6 £22 1 1 Oo -1! 
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aie 0 1 —l | 
r, — 2f2 0 1 —1 | 
0 0 0_]) 


0 
Hence, the rank of A is 3. 


Recall the explanation at the beginning of this article. The row reduc- 
tion process is just an abstract imitation of the elimination method we 
adopt in solving simultaneous linear equations, except that we now do it in 
an organised way. The row reduction worked out in Example 5.22 is there- 
fore also the method of solving the system 

x4 2y-- z= O 
—x + 3y = —4 
2x + yt 3z- —2 
x + y + Z= —I ’ 
giving the solution x = 1, y — —l,z= —l. 

This takes us to the subject of the solution of a system of linear equa- 

tions, which we srall deal with in § 5.8. 


Problem Set 5.7 


1. Reduce the following matrices to the row-reduced echelon form : 


se ee m3 2 3 #17 
@ [3-1 | © | 4 a 5: 9 
(3 1 WJ (2 1 1 Of 
ee 077 
1 #2 3 4 17 
i 2 o 1 1 | 
4 1 § ~6 10 d 
{c) he a. &- 
(2 0 2-2 64 | 
L3 —l 0 1_] 
--1 21 #21 07 
| mri 2 0 0 
es f) | 1 2-1 2 | 
) aos 
°) 0 1 2-1 | 
| io 2 21 —14 
L. 1 0-2] 
3 1 —17 - 0 6 6 14 
1 2 3 -§ 7 2 3 
h) 
e) 4 0 1 —3 2 ] 1 
hI 65) 3 m1 it—-l Of 
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10. 


ri 0 F 97 

Is 2 2 10 
(i) 

3 —2 3 Il 


[2 —1 3. 8 
Determine the column rank of the matrices in Problem | by two diffe- 
rent methods. 
Determine the row rank of the matrices in Problem 1 by two different 
methods. 
Determine which of the square matrices in Problem | are nonsingular 
and in each case find the inverse. 
Solve the following systems of linear equations by using the row- 
reduction method : 


(a) %x— 3y = | (b) y—2z=3 
x~- y+ z= 2 3x + z=4 
3x + y-—2z= 1 xty+ z=1 

(c) x— yt z= 0 (J) x—y+3z=1 
ax+ y—3z= 1 ax+y- z= 
—x+ yt2z=—-1 3x —y +2z-=2 


3x + y— z= 8 
2x— y+ z= 0. 
Prove that ‘~’ is an equivalence relation. 
In the 7 X 11 matrix on p. 187 find the numbers &,, k,, .. , k, of 
Definition 5.7.4. 
Prove Lemma 5.7.7. 


Write down the details of the proof that the row operation of type III 
does not affect the row rank of the matrix. 


True or false ? 
(a) For any matrix A, the ranks of A and A? are the same. 


(b) The row-reduced echelon form of a diagonal matrix A is A itself. 

(c) Every upper triangular matrix is row equivalent to a diagonal 
matrix. 

(d) There exists a 12 & 7 matrix of rank 10. 

(ec) The row-reduced echelon form of a symmetric matrix is also 
symmetric. ‘ 

(f) The type III operation performed on the columns of a matrix 
leaves its rank unchanged. 
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5.6 SYSTEMS OF LINEAR EQUATIONS 


In this article we shall study the general system of m linear equations in 
n unknowns. 


OgyXy “+ AgeXg + ... + CanXy = Dy 


3 Xq “+ XigrXs + eon + 2nX_n = b, \ 
: (NH) 


KenyXy Tt XmgX_ + vee + Smarty == | 
This is-called a nonhomogeneous system (NH) if at least one 4; is not zero. 
The associated homogeneous system (H) is 
Oy Xy + AyQXq foes + OyyX_ = 4 
eX, + aeaXe |... + honX, = 0 
211 222 2 \, ; (H) 


These systems can be written in matrix notation as 


Ax = b (b #9) 
and Ax =0, 
[oy Meg on. hn | 
eee 4 - Xo Xoo ese “on 


L_Om1 Smeg «+» Smn— 
x= (x1, Xa, eery Xn)T Ee Vai and b ae (b,, bs, oe) by)™ E Vine 

This operator equation is to be solved for x. The matrix A is called 
the coefficient matrix of the system. The matrix obtained by adjoining the 
column vector 5, at the end, to the matrix A, is called the augmented matrix 
of the system (NH) and is denoted by (A, 5). As usual, we consider A a 
linear transformation from V, to V,,. By Theorem 4.8.1, we have 

(i) Ax = 5 has a solution iff b € range of A. This is equivalent to 
saying (cf § 5.5) that b € span of the column vectors of A. In other words, 
A and the augmented matrix (A, 5) have the same rank. 

(ii) If Ax = b has a solution, then the solution is unique iff Ax = 0 
has the trivial solution x = 0 as its only solution. This happens iff the 
kernel of A is {0}, i.e. iff nullity of A is zero. This is equivalent to saying 
that the rank of A is 7. 

Thus, we have proved the following theorem. 


5.8.1 Theorem (a) (Existence) 7he system (NH) has a solution iff the 
matrix A and the augmented matrix (A, 6) have the same rank. 
(b) (Uniqueness) Jf the system (NH) has a solution, then the solu- 
tion is unique iff the rank of A is equal to n, 
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This theorem and Theorem 4.8.1, properly interpreted for our systems 
of equations (NH) and (H), give the following comprehensive theorem. 
5.8.2 Theorem Consider the systems of equations (NH) and(H). Let the 

rank of A ber. Then 

(a) (NH) has a solution iff (A, 6) has rank r. 

(b) Jfr— m, then (NH) always hasa solution, whatever may be b 
E Vin. z 

(c) Ifr - m == n, then (NH) has a unique solution, whatever may 
be b € V,,; and further (H) has a unique solution, namely, the trivial 
solution. 

(d) Ifr-=- m <n, whatever may be b E V,,, (NH) as well as (H) 
have an infinite number of solutions. In fact, r of the unknowns can 
be determined in terms of the remaining (n — r) unknowns, whose 
values can be arbitrarily chosen. 

(e) In the cases (i) r< m == n, (iI) < m <n, and (ii)r<in< 
m, if (NH) has a solution, then there is an infinite number of solutions. 
In fact, r of the unknowns can be dctermined in terms of the remain- 
ing (n — r) unknowns, whose values can be arbitrarily chosen. Further, 
(H) has an infinite number of solutions. 

(f) In the case r --n < m, (H) has a unique solution, namely, the 
trivial s lution, and if (NH) has a solution, then that solution is unique. 
(g) Ifm —n, (H) has a nontrivial solution iff A is singular. 


Proof: Parts (a) and (f) are only restatements of Theorem 5.8.1. 
They are included here for completeness. Part (b) follows, since r = m 
implies the range of A is V,,. Part (c) follows from part (b) and Theorem 
5.8.1 (b). Now we have to prove only parts (d), (e), and (g). 

To prove part (d), first note that, since r == m, the range of A is V,, 
and so every b € V,, has an A pre-image in V,. The kernel of A has the 
dimension n -- r > 0. So the kernel K, being a subspace, has an infinite 
number of vectors in it. By Theorem 4.8.1, it follows that the solution set 
of (NH) is a translate of K. So it also has an infinite number of vectors. 
The fact that r unknowns can be determined in terms of the remaining 
(n — r) unknowns can be seen from the row reduction process of A (see 
Example 5.23). 

To prove part (e), note that the proof is the same as that of part (4d), 
except that, first, we should know whether there exists a solution. Once 
the solution exists, the rest of the argument is tre same. 

Finally, part (g) follows from parts (e(i)) ard (c) once we recall that an 
n X n square matrix is singular iffits rank is less than n. § 

The result of this theorem can be presented as in Table 5.1. 

Let the rank of matrix A be r and that of the augmented matrix (4, 4) 
be r,. Further, let the rank of the kerne] bekK = 2» —r. Obviously, r < 
ry, <m,r<n. (Numbers within brackets refer to the parts of 
Theorem 5.8.2.) 
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TABLE 5.1 
r#Tr, The system has no solution (a) 
The system has a solution and the following hap- 
pens . (a) 
r=f, Homogeneous system ; Nonhomogeneous sys- 
(H) tem (NH) 
= sees Ax= 0) Ax -b,b tO 


— qe oe 


r= n,k=-0O | has only the trivial | has the unique solu- 
solution (c) | tion (c) 
| 


A ee 


has infinitelwmany sol- | has infinitely many 
| utions Solution space , solutions solution 
1S Of dimension | set 1s a lincar variety 
m=n[{r<n7, | whose base space 1s of 
kK on sr ya kK=n-—r_  (e(i)) | dimension A (e(1)) 


| We can find r unknowns in terms of the remain- 
| ngA& (| nn —r) unknowns, chosen arbitrarily (e) 


— —_ = eee 


r =n, hk = 0 | has only the trivial sol- | has the unique solution 
ution (f) (f) 


has infinitely many sol- | has infinitely many sol- 
utions Solution space| utions Solution set 1s 


is of dimension a linear variety whose 
m>n rw Nn, base space 1s of dimen- 


k=n-—re?l k(=n—r) (e(im)) | ston k (e(111)) 
“We can find r unknowns in terms of the remam- 
ing k (= n — r) unknowns, chosen arbitrarily (e) 
has infinitely many sol- | has infinitely many sol- 
utions Solution space | utions Solution set 1s a 


is of dimension linear variety whose 
k (=n  m) = (qd) | base space 1s of dimen- 
r= m, sion A d 
k=n—m pees: ns a we oe. Be + ie 
We can find r (= m) unknowns in terms of the 
remaining k (— mn — m) unknowns, chosen arbit- 
rarily (d) 
m<n|—— 
has infinitely many sol- | has infinitely many sol- 
utions Solution space | utions Solution set 1s 
is of dimension a linear variety whose 
rem base space 1s of dimen- 
ba k(=n-—r)  (e(si)) | sionk (e(11)) 


We can find r unknowns in terms of the remain- 
ing k (= n — r) unknowns, chosen arbitrarily (e) 
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Example 5.23 Consider the system 


2x; + Xy—% + X= 2 
xy + X3 — X%, -[- ss = l 
12x, + 2x, + 8x, + 2x, = 12. 
The augmented matrix (A, 5) 
-~201 -1 1 24 -oO 0 —] 1 —1 07 
~~ | 
= 108 -—-! 1 I flry—2n,) 10 #1 —-1 1 1 
rs id 2rs ; 
[12 2 8 0 2 12_} LO 2 —4 12-10 04 
1 0 1 —1l l 17] 
interchange 0 0 —!] = | 0 | 
ryand rg, | 
ry X 4 Lo 1-2 6-5 04 
1 0 0 0 0 17] 
Ti + May | 0 0 —! 1 —] 0 
Ms —— 2rs 
{_0 1 0 4 —3 0_| 
“1 0 0 0 17] 
interchange | 0 1 0 4 -—3 0 
r, and rs 


rs X (—1) 0 1 0 4 3 o| 


This shows 
Po — ] 
Xq + 4x, — 3x, = 0 
Xg3— xX + x= 0. 
So x, = 1 


xX, = —4x, + 3x, 
Xy = Xy — Xz. 
Rank of the coefficient matrix A = 3 = rank of the augmented matrix. 
5 —3 = 2 unknowns can be arbitrarily chosen. They are x, and x, Three 
unknowns x;, X;, and x, are determined in terms of x, and xs. There is an 
infinite number of solutions. This is case (d) of Theorem 5.8.2. 
The set of solutions can be written as 
(C1, 4x4 + 3x5, Xq — Xs Xs Xg) | Xe, Xy are arbitrary scalars} 
= {(1, 0, 0, 0, 0) + x,(0, —4, 1, 1,0) + x,(0, 3, —1, 0, 1) | Xe Xs 
are arbitrary scalars} 
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= (1, 0, 0, 0, 0) + [(0, —4, 1, 1, 0), (0, 3, —1, 0, 1). 
It is a lmear variety. Here (1, 0, 0, 0, 0) is one particular solution of the 
system and [(0, —4, 1, 1, 0), (0, 3, —1, 0, 1)] 1s the kernel of the coefficient 
matrix 4 of the system. 
Example 5 24 Consider the system 
X, + 2x, + 4x, + xX, = 4 
2x1 — x,;—3x,=4 
X,— 2x, — Xz = 0 
3x, + xX,— xX -— 5x,y= 5. 
The augmented matrix (A, 5) 


[l 2 4 1 4] 1 2 4 1 47] 
2 0-1 -3 4 r—2r,|0 —4 -—9 -—-5 —4 
= ry — 77, 
1 —2 —-1 0 0 r,—3rn, | 0 —4 -—-5 -—-1 —4 
L3 1-1 -—5 3_J LO —5-—13 -8 —7_] 


~ oO 1 &¢ @¢ 1! 
ra X (—2) 
. 0 —-4 —5 -1 —4 ° 
LO —5 —13 -8 —7_I 
cml oOo -—-} —-# 27] 
ae JOINMEFOREASY ACCESS TOEBOOKS & NOTES 
a Wey 0 1 t 1 @ +92-310-545-450-3 
ry + 4r,, Css Aspirants ebooks & Notes 
0 4 4 0 https://m.fac om/groups/458184410965870 
ret Ms 0 Qos“ Asplrants Forum 
: : rs 
L.O 0 ~ & 4 2_| i bid cleat itl sami Sal al , 
ee i el IR he rect 
~ oO 1 % ¢ 1 This Se cee as 
ry X d, 
mnx(-) |O O 1 21 0 
Lo o 1 1 FJ 
mi. 0 0-7-1 27 
rw 
3 + 2! es 0 1 0 —1 l 
Me —~ als . 
rom ts 0 0 1 1 0 


“Lo 0 0 O $. . 
The last row shows that Ox, + Ox, -+ Ox, + Ox, = 8/7, which is 
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absurd. Otherwise also it shows that the rank of A is 3 and the rank of 
(A, 5) is 4. (Why?) So the system cannot have a solution. In other 


words, the equations are inconsistent. 


Problem Set 5.8 


1. Determine whether the following systems of linear equations are con- 


sistent. 
systems. 
(a) Xy— xy 4- 2x3 + 3xy = ] 
2xX,+2x, + 2x, = ) 
4x14 Xe -- Xg—- My = l 
Xy+2X_ 4+ 3x, = l 
(c) It x—xX, + x,= 2 
Mit Xy-- Xp + Xs = I 
12x,+ 2x, 4 8x,-+ 2x,= 12 
(ec) xy — wg = l 
2X, + Xe+ X53 == 2 
X—— Xs = 3 
Xy+%_-+ Xy 4 
2Xe- Xs = 0 

(g) 2x, + xe+ vy + 4% —- 2 
3X, — Xet Xs — X, = 2 
X, +2xX, —Xx3 + xX, = 1 
6x, +2x, -- x5 + Xx, = 5 

(i) x, —2x, —x, = —] 
2x4 —-X%y—-3X = l 
3x, + %,— X%3—5xe = l 

2x4 +3x,3 +x, = O 

(k) xy —X3 = 2 
Xy+ X_g+2x, = 4 
Xi+ Xg—2Xy = 4 
Xt X_ +X; = 4 
Xy+ 3X, —Xyg = 8 

(m) x, -+ xXs— x,—6x,+6x,= —19 
x; + 7x,—7x,= 28 

2%_—3X5+18x,—4x,== 24 


(b) 


(d) 


(f) 


(h) 


(i) 


(I) 


(n) 


Xy + 2X -+ 4x5 
2x, — Xs 
1 2X» — Xs, 
3X, -+ Xe— Xe 


Xy + 2x,g— Xz 
2x, -+ 4x, + 2x, 
3X; + 6x_ + 3x, 
x, +- 2x, 
2x, -+ X_2 4- 2x, 

X_g — 2X, 

Xi + Xe 
Xy—~ X24 4x, 
x) =| 3X a 3X3 
4x, + X_— 2x5 
6x, + 5X -|- 10X5 
x, + 2x, + 3x, 
3x, + 6X, + 3x, 
Xy + 2x,— Xz, 
3x, + 6x, + Xs 
Xy + 2x, + 2x, 
2X1 + Xe + 2X, 


Xy-f Xs 
Xx, — 2x, + 6x, 
XY a 2X3 


Xy— X,+ 4x, 
Xi — 3x, + Xz 
2x4 + 4x, — Xs 
2X, + Xe 


3.9 MATRIX INVERSION 


In this article we apply the method of row-reduction to find the inverse 
of a nonsingular matrix. Let 4 be ana x n matrix, which is nonsingular. 


Then A-? exists. 
this we can proceed as follows : 


1: eed dd 


— x= 
+6x,= 
+ %= 


Discuss completely the solution in the case of consistent 


DAAIANK WORK WHWORURAUHE SE Bee Qjaowu3)]8|pa 


Look at the equation Ax = b, where 6b + 0. To solve 
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Ax = 5b. 
Therefore, A-(Ax) = Aq'b 
or (ATA)a = AND 
or 1,x = A 6b 
or x =A ld, 


So, solving the equation 4x = b is equivalent to finding A“4b. But the 
solution of equations can be done by the process of row reduction. There- 
fore, the method of row reduction will also be adaptable to find A-1b and 
consequently A~'. We can write the equation Ax = b as 


Ax =I,b. (1) 
Therefore A ‘Ax = AU,b, 
i.e. I,x = A“. (2) 


In the process of reduction we always work from A and arrive at /, 
(see Coro lary 5.7.12). Equations (1) and (2) indicate that, if the same 
row reduction is applied to /,, the identity matrix, then we end up with the 
matrix A! on the right-hand side of (1). Thus, we have the following 
method of inverting A. 

Perform a sequence of elementary row operations on A so that it 
reduces to J, Perform the same sequence of elementary row operations 
on the matrix 7,. The resulting matrix 1s Aq’. 

In practice, we perform the sequence of elementary row operations on 
A and J, simultaneously, keeping them side by side as illustrated in the 
following example. 


Example 5.25. Invert the matrix 


1 1 07 
| 1 —!1 l ; 
LI -1! 2_] 


Note Whether the matrix is nonsingular or not will also be clear by the 
process of row reduction. If the final matrix has all its rows nonzero, then 
the original matrix should be nonsingular. (Why ?) 

We write the 3 x 3 matrix A and the matrix J, side by side and 
obtain a3 x 6 matrix with a vertical line separating the entries of the 
matrices A and J, as shown below. Then we perform the elementary row 
operations on this 3 x 6 matmx in such a way that the entries on the left- 
hand side of the vertical line ultimately form J,. The entries on the right- 
hand side of the vertical line then give the required inverse of A. The 3 x 6 
matrix used here 1s called the enlarged matrix of A. : 


mi ot O07; 1 O O7 
1-1 t]0 2 OfF° 
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riot 0 1 0 OF 
ry — Nh, | ° a2 fd ae: 4 7 
ig — fr, 

Lo -2 2]-1 o 443 


rio: 0; 1 0 0F 


I x (—P), | 0 1 --4 + —} 0 | 
rs X (—4) 
LO 1-1! 4% oO —4) 
Fl 1 O71 O08 @© 
aes | 0 1 --} 3 —-} O | 
Lo O -} 10 4 -}) 
_ Z 1 O | 1 0 Of 
mxCD/O UV -2) da 0 | 
L_0 0 1; 0 —1 1_] 
1 1] 0 l 0 077 
rs hi? | o 1 Of; 4 -1 3 | 
LO 0 0 —l 1_] 
ri 0 OF; & t 37 
ae lg | 0 l 0 $ —l 3 
Lo 0 1 | QO —!I 1_]| 
Te | —H1 
Hence, oo ,} —] ‘ 
LO —1 ] 


The reader is advised to check that AA“ is indeed J, and so also is A7A. 


Problem Set 5.9 


1, Using the row reduction method, determine which of the square 
matrices of Problem 1, Problem Set 5.5, are nonsingular and in each 
of these cases find the inverse. 

2. Repeat Problem | for the matrices of Problem 2, Problem Set 5.5. 

3. Repeat Problem | for the square matrices of Problem 1, Problem Set 
YB 


Chapter 6 


Determinants 


6.1 DEFINITION 


We start with some preliminaries on permutations of the set {1, 2, ..., 
n}, 
6.1.1 Definition An ordered pair (p, g) of distinct positive integers p 
and q is said to be an inversion if p > q. 
For example, (5, 3) 1s an inversion but (3, 5) 1s not. 


6.1.2 Definition Given a permutation P = (j,,/:, ..,Jn) of the set 
{1, 2, ..., n}, we define the set 


®p ie {Chas Jo)s (his Ja). reg Cis, Jn)s 
(des Js)» eoeg (jas Jn)> 


The number of inversions in ®p is called the number of inversions in 
the permutation P. 
Example 6.1 Let P be the permutation (3, 4, 1, 5, 2). Then Op 
{(3, 4), (3, 1), 3, 5)s (3, 2)s (4, 1), (4, 5), (4 2), (Is 5) (1, 2), (5, 2)}. Count- 
ing the inversions, we see that the number of inversions in P is 5. 


6.1.3 Definition A permutation (j,, jo, .... jn) of the set {1, 2, ..., m} is 
said to be an even (odd) permutation if the number of inversions in it 
is even (odd). 

Examp!e 6.2 The permutation (3, 4, 1, 5, 2) in Example 6.1 is an odd per- 

mutation, whereas (3, 1, 4, 5, 2) is an even permutation. 

Now let us take up the definition of a determinant.: To each ” x n 
matrix A of numbers we associate a number called the determinant of A in 
the following manner. Let 
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[oy 19 eee Cin | 
Ooy hao eee Xen 
A= 
| Ons Ans eee Sun —_f 
Form all products of the type 
“1, bad 3 ara) ony, ’ 


in that order (the ascending order of row indices). Here (j;, j:, ..:, jn) iS a 
permutation of the set {1, 2, -.., 2} of column indices. Note that each such 
product contains one (and only one) term from each row and each column 
of the matrix. To each such product assign a ‘plus’ sign or a ‘minus’ sign 
according as the permutation ( j;, je, ..., jn) is even or odd. The algebraic 
sum of all these signed products is called the determinant of A. It is de- 
noted by det A or | 4 | or 


~~ 


Qiy Cis aes Kin | 
Oey Xoo sos on 
ny Ene eee Can 


This last symbol is itself called a determinant of order n. The precise defi- 
nition is as follows. - 


6.1.4 Definition If 


[ayy Cie one in | 
Xo Gee one Cen 
A= g (1) 
L_ Ons Snes eee Cnn I 
then 
det A = 2 “Cis jas very Jn) Hs, KDje one omy s (2) 


where the summation is taken over all possible products of the form 
1), “27, ... Snj,» in that order, and 
(+1 if (iis das woog Jn) is 
P = an even permutation 
Chis Jer ---r dn) | if (jas Ja» «*+>Jn) is 


an odd permutation. 


The right-hand side of Equation (2) is called the expansion of the deter- 
minant of A. 


6.1 DEFINITION / 205 


Note that there are m! terms in the expansion of det A, because there 
are ni permutations of the set {1, 2, -., 2} of column indices, and to each 
such permutation (/,, /,, ..-» Jn) we get a product a Wj, %2j, «++ Cn, In fact, 


the permutation (j,, jo .- , jn) tells us the order in which the column. indi- 
ces are chosen to form the product. 


6.1.5 Remark Det 4 1s defined only when A 1s a square matrix. If A is 
not a square matrix, det A is not defined. 
Example 6.3 Let 


[ayy Ka Ay, | 

{ 

{ 

A = X14 Xe 723 | . 
[a3 732 35 | 


Here the six possible products are 04,%42% 335 %11% 24% 2. %12%37% 31> %19%e1% gg, 
Xy3%ei%Xsq, Ayghae%sz. The signs to be attached to these products are 
determined as follows: For example, take ;,%.:2,, The order of the 
columns chosen here 1s (2, 1, 3). This is an odd permutation. So the 
sign to be attached to this product 1s ‘minus’ Doing this for every pro- 
duct, we finally get ° 


{ A | = Oyher%y, — %ar%24%aq + H12%93%q1 — 12% 91% ga 
HF Myg%q1%j2 — Ly 4hou%gy - (3) 
As a numerical example, we may take 
2 —!l 3 
=2x4x2-2x0x14+(-1)x0*x 
1 4 0 (-1)—-(-)) xX1x14+3xK1xK1—- 
3x 4x (—1) = 22. 
-—| ] Ls 
A careful arrangement of the six terms in Equation (3) gives 
11 ia 413 
= O11(X22%g5 - Og 30g2) + Oya(%e9%31 — Op 1%g5)° 
O91 Age Xeg H- 1 3(%e1% 52 — Mgg%q3) - 
%31 Age O33 
Clearly, 
Ay tn 


= a8, — a6, and 


PB, Bs 
if A isal xX 1 matrix {a,], then det A = a. 

When it comes to considering determinants of the fourth and higher 
orders, the calculation involved in writing out all the terms becomes prohi- 
bitive. So we study further properties of determinants and arrive at 
shorter methods of calculating det A. However, certain special determi- 
nants can be evaluated directly from the definition, for example, 
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0 A» O 


— AyAg eos As e 


0 0 0 ae. OMe 
In particular, det J, = 1 and det 0,x,, = 0. 


Problem Set 6.1 


1. Determine whether each of the following permutations is even or 
odd : 
(a) (I, 3, 5, 6, 4, 2) (b) (3, 4, 5, 2,1, 6) , 
(c) (2, 6, 4, 3, > 1) (d) ql, 4, 3, Z, 5) e 

2. Write down all possible permutations of the set A and Separate the 
odd and even ones : 


(a) A = {1, 2, 3} (b) A -- {1, 2, 3, 4} . 
3. Find det A for the given matrix A: , 
1 3 0 3 ] 2 
(a) A == i ] 2 (b) A=] 5 0 QO 
Li 0 0 i 1 0 
4. Evaluate the following determinants : 
1 x x?| 1 x yz abe 
(a) jit y y (b) 11 y zx (c)_ jc a b!. 
122 lL z xy bea | 


3. Prove that the solution of the system 
Aix, -- agXg = 8, 
Bix, + Bx, = 8, 


5; Xe Ry oe | 

2 5, Be By 8, 

is x,= ——, %»= — ; 
Xy Xo Ky, Lo 
B, B, By B. 


provided that «,6, + «,§). 
6. True or false ? 
(a) If (a, b, c) is an even permutation, then (3, a, c) is odd. 
(b) The sign attached to the product 9,%,,%5, of a third order de- 
terminant is ‘plus’. 


6.2 FUNDAMENTAL PROPERTIES OF DETERMINANTS / 207 


0 1 >| 
(c) 2 0 —-4'=0, 
1-5 5 0 
0 1 1 
(d) | 2 0 O;=0. 
l-s 55 
}2 —~—A? 3 


(e) The equation — Q has no real root. 


1—A 
(f) The determinant of a triangular matrix is the product of its 
diagonal entries. 


[1 ya 
(g) | [|= —2. 
L3 4.) 
1 i 
(h) [=o 
af 


6.2 FUNDAMENTAL PROPERTIES 
OF DETERMINANTS 


The fundamental properties of determinants, which follow immedia- 
tely from the definition, are given in this article in the form of theorems. 
Of these, the proofs of Theorems 6.2.1 and 6.2.8 (see § 6.3) are rather com- 
plicated, and a beginner may skip them on his first reading. In this article 
A = (a,,;) stands for anm X n matrix. 

6.2.1 Theorem If the matrix B is obtained from A by an elementary row 


weer aeecruwre vy wre & Vseete GTEEUT Vso whores wrrwW EWI, FIEwte ee a 


For the proof see § 6.3. 
Example 6 4 1 2 3 4 | 1 2 3 4 
—1 0 1 2 | 1-1 2 3 
o 1 4 of | 0 1 4 0 
1 —l 2 3 | —] 0 1 2 


because the determinant on the right-hand side is just the determinant on 
the left-hand side with the second and fourth rows interchanged. 
6.2.2 Theorem If A has two identical rows, then det A = 0. 

oof: Acan be considered as being obtained from itself by inter- 
changing the two identical rows. So, by Theorem 6.2.1, det A = —det 4. 
Hence, det 4d = 0. § 
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Example 6.5 | 2 3 -!I 4 
4 I 0 ~—!1 
1 2 —3 | 
4 l 0 --l 


without any further calculation. 


6.2.3 Theorem Jf A has a row of zeros, then det A - OQ. 


Proof: det A =-2 Sinton vIn) 7M "2g 7 “nj If the k-th row is the 


zero vector, then Op is zero for every choice of j,. Therefore, each 
product is zero and this gives det A - 0. § 


Example66 2 l 3) 
0 0 0! 0 
lig 10 
without any further calculation. 
6.2.4 Theorem Jf the k-th row vector r, of A is the sum of two vectors b, 
and c, of V,, then| A| |BIt | Cl], where B is the matrix 


obtained from A when r, is replaced by b,, and C is the matrix 
obtained from A when r, is replaced by c,. 


Before we take up the proof, we shall illustrate the result by a simple 
example. 


Example 6.7 Oy Oe Os | 
By B, By By 
by -t Cy bt te by t+eg Ate, 


1 8) 3, 8; 5, 
Z, & ey Xe | Hy Bo hy Ay 
Pr Be By By : B, Be Bs By 
b, b, by by Cy C2 Cg 


ne ee Pe 
Proof of Theorem 6.2.4 Let by = (Bpy, Deo, ..-> Ben) and Cy = (Car, 
Crag, «++» Cen). Then Oe = b kia t CK for every k. This shows that each 
product a, a be written as (a), Ooi by, sis aa) 


T @),, | a "Khe a “njy)" 


6.2 FUNDAMENTAL PROPERTIES OF DETERMINANTS / 209 


The algebraic sum of the first type of products with the appropriate 
signs gives det B, and the algebraic sum of the second type of products 
with the appropriate signs gives det C. Hence the result. Jj 
6.2.5 Theorem If the matrix B is obtained from A by an elementary 


operation of type II (ie. multiplying any row vector by a nonzero 
scalar c), then'det B == c det A. 


Example 6.8 a bh «eg | 4% b, ¢, ! 
| Cay cb, CCy ~ ¢c | a> b, Cs ! . 
a, by Cg la, bs Cg! 


Proof of Theorem 6.2.5. Let the k-th row of A be multiplied by c. 
Then the k-th row of B is (coy1, Cxxo. »--) C%an). SO, in the expansion of 
det B each product is of the form x Li 2h (ca, ) sie Ong This shows that 


every term of the expansion of det B is a multiple of the corresponding 
term by a factor c, in the expansion of det A. Hence, det B =: c detdA. § 
Note that Theorem 6.2.5 holds even if c = 0. 
6.2.6 Theorem If the matrix B is obtained from A by an elementary row 
operation of t) pe III (i.e. adding c times the s-th row to the k-th row), 
then det B = det A. 


Example'6.9 \ a, a, a, | Gd, a, a; | 
} 


{ 
b, f oC, b, 7 aCy b, 4 C5 i b, bs b, 


C1 Cy Cs l Cy Cy, Og 
Example 610 \1 2 3 1 2 3 1 2 y 
44 4|--| 4 4 A a 
5 6 7 5—~16~—~27—3 4 4 4 


by Theorem 6.2.2. 
Proof of Theorem 6.2.6 Let the k-th row of B be r, + cr,, where ry 
and r, are the k-th and s-th rows of A. So, by Theorem 6.2.4, 


1. yg wee an | To eC 

Ley Lee eee Cen CXs1 ae eee Chen => k-th row. 
det B = taf 

Oss Aes eae Ken Le ST eg seo Cen —_> s-th row. 


Oy, Ong cos Sun» nr Sng  --- San 
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Applying Theorem 6.2.5, we obtain 


Airy Kyo one hin 


| 
| oy Kaa ees an 


det B= detA jc |; 
| 


| %a. ag Sen 
a a ee 
= det A (by Theorem 6.2.2). §j 


6.2.7 Remark Theorems 6.2.1, 6.2.5, and 6.2.6 tell us that the effect ofa 
finite number of elementary row operations (of any or all of the three 
types) on det A is to multiply it by a nonzero scalar. 

6.2.8 Theorem det AT -= dct A. 

For the proof see § 6.3. 


Example 6.11 ig 3 4 | 2 5 3 | 
i 7 Ble Ta 7 2ip.. 
3 --] 2 4 3 2 | 


6.2.9 Theorem Theorems 6.2.1 to 6.26 are true if everywhere the word 
‘row(s)’ ts Changed to ‘column(s)’. 
This ts a consequence of Theorem 6.2.8. 

6.2.10 Remark As a consequence cf Theorem 6.2.9 the elementary 
operations can be performed as well on the columns of a determi 
nant, with the same effect as that on rows. 

Example 6.12 Evaluate 


I 2 3 
| 
[Al =| 2 —1 "| 
-~| 0 ] 
J 2 3 I 2 | 
| 
ae 2-1 O0;}=/0 —S —6 
| | 0 ! 0 2 . 
by rz — 2r, and r, + r,. Using Theorem 6.2.8, we get 
1 0 0 
[A] =|2 —-5 2l=1-x(-5)x4—1x2~x(-)=-8 
3 —6 4j 


as all other products are zero. 
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Problem Set 6.2 


If A is a square matrix of order m and « a scalar, then prove that 
det (2A) = a" det A. 


Let A be a skew-symmetric matrix of odd order. Then prove that 
det A == 0. 


For a triangular matrix A, prove that det A is the product of its dia- 
gonal entries. 


Prove that 
1 a af _ 1 a4 8! 
1g @l=U—8) 1 BB 
1 8 8 i1 8 8&8 
0 | P| 
~@-AG—NG—2)/0 0 1 . 
11 68 8 | 
Without cxpanding, prove that 
i Jt 3 | 5 te 1 at 
a) |2 9 I= bo) [eda 1 6]=0 
4 i] ‘ lbtal _e¢| 
abe y 5b gq x y zi! 
() |x y zl=|x ap =|p ari 
Po@ r | zeri abe! 
x y = |} 1 J| 
ole p ajalp ee 
yz 2x xy xy z 
atb b+ce+a ab c 
() |pt+aqaqtrrip|=2|p qr 
x+y yt2z z+x x yp z 
x x+3 x+ 6 4 7 10 


(ff) jxti x+4 x+7/=0 (g) 0 13 16] =0 
x+2 x+5 x+8 '20 23 26 
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(h) 


la a® — be x—y ypr-zz—x 


1 b B~-~cal|=0 (i) |jy—z z—x x-—-yl=0. 


1 c¢ e&—ab z—-X x—y y-z2 


6. True or false ? 


(a) 


(b) 


(c) 


(e) 


(f) 


(g) 


(b) 


If every row of a determinant of order n(/ 1) is multiplied by 
k and every column by k’, then the value of the determinant is 
multiplied by kk’. 

If the diagonal entries of a determinant are multiplied by k, 
then the value of the determinant is multiplied by k. 


abeoe a b at b| 

2a 2b tc, =6abe. (d) jc d c+aj=0. 

3a 3b 3c e fet+f 

O+a Atp At b a Py |, A, Pa ls 
b+ bp A+ mm tm) = 1b, gy om) +) bg, m 
Cte, A+rs Mm + Me Ch ory My a ry Mg 
aa a aa a 

be VWi=-—|{b b B 

‘¢c ¢ ¢ ce ¢ 

a 0 "4 2 0 0 

b 0 0 =e 0 0 

lo d J lO a b 

@, a, “ \4,5—b, a,—b, a, — by 

'b, b, bs: = |b, — ec, by— cy by — cs]. 

Cy Ca és | [Cy — GQ, Cg—Q@g Cy — Qs 


6.3 PROOFS OF THEOREMS 


To prove Theorem 6.2.1 we need the following two lemmas. 


6.3.1 Lemma Let p be the number of inversions in a permutation 
P = (Jj, Joy.» Jn) Of the integers 1,2, 3, ...,". Let Q be the permu- 
tation obtained from P by changing two adjacent entries of P. Then 
the number of inversions in Q is p 4.1. 
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Proof: Let j, and jri, be interchanged in P to produce Q 
= (fis Jay ones Je-y Jevis Ses Setss »-» Jn). We have 
Dp = {(i, Ja), Ci, Js), sory (i, Je-1)s Ci Je), (iss Jerr), eerg (his Jn), 
( jas js), ek Cia, Je-1) (js; Je), (Jas Seta) cory (Jar Jn) 
Cie-15 Je), = Jer) 9 Ce-1) In), 
Cins Jeva)s «> » Ue8 Ja)» 
Gn Jn)}- 
The set Q is obtained from ®p by interchanging j, and j,4,. Careful 
scrutiny shows that ®q 1s different from Pp in only two ways, namely, 
(i) Q does not contain (j;, jei1), Whereas Dp contains it, and 
(u) Pp does not contain ( jr+1,j,), Whereas DQ contains it. 


Since either (jx, jea1) OF (Jets, Je) iS an inversion, it follows that when 
we change from P to Q the number of inversions ts either increased by 
one or decreased by one. Hence the result. 


6.3.2 Lemma [f the matrix B is obtained from the matrix A = (%,;)axn by 
interchanging two adjacent rows, then det B = —det A. 


Proof: Suppose the k-th and (k + 1)-th rows of A are inter- 
changed to produce B. The typical term in the expansion of det 4 is, 
keeping the row indices in the natural order, 


1 Og hte ht As dete K+, dete “nin * 


Denoting the entries of B by f,;, we have the corresponding typical pro- 
duct in the expansion of det B: 


Pip Pay oo Pag Pett, jets Brin Wa “2h “ht ie “Mets “Me 
(because the k-th row of B is the (kK + 1)-th 
row of A and vice versa) 


= Fy or | a “Ket k+1 Je ose Oe ° 
By Lemma 6.3.1, we have 


al OS woop dk SEEM» ae "hy, Ja» cory Jets dks ores Jn) 7 
Hence the result. §j 


Proof of Theorem 6.2.1 The theorem has just been proved in 
Lemma 6.3.2 for interchanges of two adjacent rows. Now, suppose the 
k-th and s-th rows are interchanged to get B. This transition from A to 
B can be made by carrying out the following operations successively ; 


Let s > kK + 1 and let there be t rows between the k-th row and the 
s-th row. Let r, stand for the p-th row, p = 1,2,...,”. 7, can be 
brought to a position immediately above r,, by t + 1 successive inter- 
changes of adjacent rows. After this, r, can be brought to the position 
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originally occupied by r,, by making ¢ successive interchanges of adjacent 
rows. Thus, the interchange of r, and r, is equivalent to making (tf + 1) 
+ ¢ = 2t + 1 successive interchanges of adjacent rows. By Lemma 
6.3.2, the value of the determinant undergoes a change in sign (2¢ + 1) 
times and therefore changes sign ultimately. Hence, det B = —det A. § 

Proof of Theorem 6.2.8 A and AT are both square matrices cof the 
same order. So the expansion cf det A and det A’ have the same number 
of terms. Each term is a product obtained by taking one (and oniy one) 
entry from each row and each column in the matrix, and attaching a 
certal sign to it. In view of this, we see that, ignoring these signs 
temporarily, every product that occurs in the expansion of det AT also 
occurs in that of det A and vice versa. In order to complete the proof we 
have therefore to show only that the signs attached to the products also 
coincide, irrespective of whether they are obtained in the expansion of 
det A? or in that of det A. We shall prove this in the following manner : 

Let A = (9,,)axn. Then AT = (#1;)ncn. Where o/, == «,,. A typical 
term in det A? is 


“Cade dn) Uy ah ne s (1) 
Taking product (1), without the sign, we have 


“Hh “2a Onin 
AN AR ign’ 2) 
Here (j:; jes .--» Jn) 1S a permutation of the set {1, 2, ..., m}. Hence, 
jy, = 1 for some k, € {I, 2, .. _ 
ky == 2 for some k, € {1, 2, ..., m}, where k, / ky, 
i = n for some ek, € a, 2, ai where k, 4 ky-1, .. , Ka, ky. 
So product (2), without the sign ficioe is 
"Tg ht "Ty As >* “Tk é 
i.e. 
ee (3) 
Product (3) is the form of the product as it occurs in det A. The sign 
attached to preduct (3) in det A is €(k1, Key «)Kn). The sign attached 
to product (2) in det AT is, from product (1), €( j,, j,, ..., jn)’ 

If we can prove that these two signs are the same, we would be 
through. These signs depend on the number of inversions in the permu- 
tations P = (ji, js, ---»/n) and QO = (k,, ks, ...,kn). So we shall now 
analyse the process by which we obtained the rearrangement (3) from (2). 

Both (2) and (3) represent the same product. The entries in product 
(2) have the column indices in the natural order 1, 2, ..., 7, wherecs the 
entries in product (3) have the row indices in the natural order. The 
order of rows in product (2) is P and the order of columns in product (3) 
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is Q. The passage from product (2) to product (3) 1s nothing but the 
rearrangement of P in the natural order. It is presented schematically im 
Table 6.1. 


TABLE 6.1 
Order of rows Order of columns 
= (Jas das on In) (1, 2, .. 4) 
= (Ji J2» gee | Ik, Jn) (I, 2, “3 ky, eoeg n) 
1 f interchanges { 


Ci» js seey Jpop. Jet, (k,, l, Ds ky ns I, k, -+- I, arey n) 


-serdn) 
Ci,» He adh re Jn) (k,, P 2, vesy ks, ‘4 n) 
+ s interchanges { 
\ 

Cig» Ike Tis Jes seta) (Ay, k,, I, 2; “99 n) 

e | | 
Ci, Ihe o' 9 J) (kK, k., oe9 Kn) 

= (1, 2,..., 7) = 


— ee RS ee ee a 


The first line in Table 6.1 indicates the order of rows (--P) and the 
order of columns (natural order) in product (2). The last line indicates 
the order of rows (natural order) and the ofder of columns (=Q) in 
product (3). 

The passage from product (2) to product (3) presented in Table 6.1 can 
be realised by successive interchanges of adjucent entries in the respective 
permutations. Since P == (j;, Je, ...»Jn)» look for jy, = | and bring it to 
the first position by interchanging it successively with all the entries 
preceding it. This needs a certain number of interchanges, say t. The 
effect of these interchanges is to reduce the number of inversions in P by ¢. 
If we make the samz kind and number of interchanges in the order of 
columns, namely, the natural order 1, 2, 3, ...,m, we get (k,, 1, 2, ..., 
k, —1,k, + 1,..., 7), the effect of which is to increase the nuihber of 
inversions in (1, 2, ..., 1) by ¢. 

Now we look for jk, == 2 and bring it to the second position by 
making successive interchanges. Suppose this requires s interchanges. 
The same s interchanges carried out on the order of columns will bring k, 
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to the second position. The effect of this is to reduce the number of 
inversions in the order of rows by s and increase the number of inversions 
in the order of columns by s. 

Carrying on this process, we arrive at x,» Sug? sos Iicy)s i.e. the natu- 


ral order on the left and at @ = (k,, ka, ..., K,) on the right. Thus, the 
number of interchanges required to bring P to the natural order is the 
same as the number of interchanges required to bring (1, 2, «-., m) to 
(k,, Ke, ..-» Kn) = Q. Since the number of inversions in (1, 2, ..., ) is 
zero, it follows that the number of inversions in P is the same as the num- 
ber of inversions in@. Hence, & ; 4. i.) = "(k,, ke, ..., keg) and the 
proof is over. §J 


6.4 COFACTORS 


The expansion of an n-th order determinant is the sum of all the n! 
terms, each of which is a product obtained by taking one (and only one) 
element from each row and each column. Let A = (a;;)nxn. Suppose we 
collect all the terms in the expansion of det A, in which the fixed element 
oy appears as a factor, and write down their sum in the factored form 
ayAy. Here A, denotes the factor remaining when the element «,, is fac- 
tored out. We call A,, the cofactor of «,; in det A. 


Example 6.13 | oy “iq O19 | = yx (%eg% qq — Xag%ga) 
Xe, Aq Ags + Oy9(%e3% 1 — O%o%33) 
X31 Sag gg + A13(%91%5_ — Oga%gr) 5 
So Ai, — cofactor of Oy = ZooKaq — KogXaqg 


Ars = cofactor of Ayq = Aqg%q1 “~~ Aq1%gq 
Ais = cofactor of 13 = Oe Xso = Agg%oy e 
If we want any other cofactor, say A,,, we have to rearrange the above 
expansion and collect the terms containing «,5. Thus, we see that Aj, 
= AyeXqq —— Xy1%gq. 
An explicit formula for the cofactor of «,; is given by Theorem 6.4.2. 
For this we need the following definition. 
6.4.1 Definition The determinant obtained by deleting the i-th row and 
the j-th column in det A is denoted by Ay;. 
Ay is also called the minor of the element «,, in det A, but we shall 
not use this terminology. 
Oy, yg Ag 
Example 6.14 For the determinant | ag; gg %og| , 


&e1 Seg Ags 
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Sgn Xeg Lig Ay 
Au = ’ Ay = 
Asq Xe | Aye Ags 
and so on. 
Example 6.15 If A = (a4)exn, then 
O11 Kis o° Gy a-} 
ex Qos oe Oey ny 


Sa-1r1 Am-tyg ses Samay ny | 
6.4.2 Theorem Let A = (a4j)nxn. Then for each i= 1, 2, .... m and 
j= 1,2,..., 4, 
Ay =(-1)'#A,,. (1) 
Proof: First, we shall prove a special case of the theorem, namely, 
that A,, == A,y. To prove this we collect all the terms INVOlVing an, 
They are of the form 


“(Sus Jy eee, In-1s n) 1 Ay Qa — “nl, In-s nn » 
where ( ji, jas --+» Jn 1) is a permutation of the set {1, 2, ...,(m — 1)}. The 
sum of all these terms is ¢n,Ann- But 
“Cite das ves dns ™) ~ "(his das +» dna) » 
since the integer n occurring last does not increase or decrease the number 
of inversions in (/;, je, »**)"Jn-1). Therefore, 


Ann = » “(his das ordn-v) “yy “jy “n— Is Inna 
Oa, . is ose) hts n-1 
Sey Lge coo as n—1 og: 
= (by definition of a 
: : H determinant) 


On-ts1 Sntyg °° Onias n—1 
= A,,. 
Now we take up the general case and reduce it to the special case. We 
have 
P: Q@: R 


fers “$7 Pe os 
where P, QO, R, S, 7, U, V, and W are mere abbreviations-for the remaining 
cotries. U, V, and W have (n -- i) rows; R, T, and W have (n — j) 
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columns; S and 7 have oniy one rcw, and Q, V have only one column. 
Clearly, 


P R 
Ag == 


(2) 
U Ww 


Shifting the i-th row by successive interchanges with the (m — i) rows of 
U, V, and W, we get 


PQ R| 


det A =(-—1)"*|U V W (by Theorem 6.2.1). 


5 ey T 
Again, by another series of interchanges of the j-th column with (n — /) 


columns of R, W, and 7 and by applying Theorems 6.2.1 and 6.2.9, 
we get 


P RQ 
det A = (—1)""* (—1)""7]U W V 
S T «a, 
So the cofactor of «,, in det A 
|'P R Q 


= (--1)*) x cofactor of a,,;in| OU W V 
S T PF 
'P R 
= (—1f? x , 
| U W 
by the preceding part of the proof. Hence, A,, = (—1)'t) A, by 
Equation (2). §j 
Example 6.16 Consider 
ah sf 
hobf.. 
ig fie| 


The cofactor of h occurring in the second row, first column, is 


(—1)4 pee —(he ce gf) = fg — ch. 


The cofactor of f occurring in the third row, second column, is 


(-1)* 


gh — af 
= — @ ‘ 
S 
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Since this determinant is symmetric, the cofactors of elements, 
which are symmetrically placed with respect to the diagonal, are the same. 
So, for example, we need not distinguish between o,, = A and ag, = A. 
Both hive the same cofactor. (Check!) Denoting the cofactors by 
capital letters, we have 

A -=be —f?, B=ca—g*?, C=ab--h, 
F == gh —af, G=hf — bg, H=fg— ch. 
The n! terms that occur in the expansion of det A can be separated 


into 7 groups as follows : , 


(1) all terms containing «,, 
(2) all terms containing a,, 


(m) all terms containing a, . 

Each of these groups contains (m — 1)! terms, since this is the 
number of terms in any A,,, which is a determinant of order (n — 1). 
These group, are mutually exclusive, because when a term contains q,,, 
it cannot conta'n any other element from the first row. Thus, there ate 
n mutually exclusive gioups, each containing (7 — 1)! terms. Therefore, 
the total number ‘of terms in all these groups s 7 x (n- I)! = al. 
Hence, it follows that all the terms in the expansion of det A are exhaust- 
ed by this grouping. Thus, we have 

det A = 04,4), + %2Aye +... + OinAin - (3) 

If, instead of the first row, we focus our attention on the elements of 
the i-th row and collect terms mvolving a,,, a.,-., etc, we get, by the 
same argument :s that which resulted in Equation (3) : 

det A = @,,A., + agdeg +... + Cindin - (4) 

Similarly, we can work with the elements of any column, say the j-th 

column, to get 


det A = 04541; - &e;A>, S Sai OnzAnj . (5) 
Thus, we have proved the following theorem. 


6.4.3 Theorem Jf A = (a,;) is a square matrix of order n and Aj; denotes 
the cofactor of 0,, in det A, then, for each i = 1, 2,..., 7 


det A = Po OrnAre (6) 
and, for each j = 1, 2,..., M, 
n 
det A are Op; Ag, . ‘ (7) 
=! 


Equation (6) is called the expansion of det A in terms of the i-th 
row and Equation (7) is called the expansion of det Ain terms of the j-th 
column. ’ 
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Example 6.17 Evaluate 
ah g 


A=|h b f 


gfe 
Expansion in terms of the first row gives 
A=aA+hH + gG. 
Expansion in terms of the second row gives 
© A=hH + 5B + fF, 
and expansion in terms of the third column gives 
A= gG+ fF + cC. 
Taking any one of these, we get 
A=@aA+hH + eG 
= a(be — f*) + h( fg — ch) + 9( fh — bg) 
= abe + 2fgh — af? — bg? — ch®. 
In order to evaluate a determinant, we usually use the theorems of 
§ 6.2 to introduce as many zeros as possible in any row (column) and then 
expand in terms of that row (column). 


Example 6.18 Evaluate 


2 1 —3 4 
1 0 —1l 2 
A = 
3 —2 1 0 
—! 4 2 1 
Multiplying the first row by 2 and adding it to the third ruw, we get 
21-3 4 21 —3 4 
10 —1 2 10 -!1 2 
A= == 
70 —5 8i|r,—4rn,) 70 —5 8 
—1 4 2 1 —9 0 14 —I5 
Expanding A in terms of the second column, we get 
> 1 —l 2 10 0 
Cy t+ Cy, 
—9 14 —15{ c, — 2¢, —9 5 3 


where c, denotes the i-th column. Now expansion in terms of the first 
TOW gives 


2 —6 


5 
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6.4.4 Theorem Let the row vectors of the square matrix A = (a,)ex, b€ 
Ti, Vey -0+y Tn» Let the vector R, denote the vector of cofactors, in 
det A, of the clement of r;. In other words, 


i= (a4, Kegs °* » Rgzy woes Sin) 


and R; — (An, Ais, seeg A,5, eaeg Arn) ° 
Then r, - R, = det A for alli=1,2,. ,n, 
and r, °R,;=0 if i # j. 


In short, r; - Ry = 8,; det A for alli, j = 1,2, --,m. 


Proof: The first result is only a restatement of Equation (6). To 
prove the second result, let us construct a matrix B by replacing the j-th 
row of A by the i-th row of A. Note that the :-th row of A remains as it 
is in this construction. So 


Oy Og -. Bn | 

et X39 aee Ken —_> i-th row 
det B = 

ey Oo .. Xin | —> j-th Tow 

Ont Sng ef. Lan 


This determinant is zero, because two rows are identical. On the other 
hand, we can expand det B in terms of its j-th row. Since the deletion of 
the j-th row and the k-th column of det B gives the same Aj, as the 
deletion of the j-th row and the k-th column of det A, we get 


O = det B= a,Ayy + ag Ayg + ... + Orn Asn 
=r, R;. § 
6.4.5 Remark A similar result as in Theorem 6.4.4 is true for columns. 
6.4.6 Corollary Let A be the matrix (a1j)nx, and B the matrix (Bi)axns 
where B,; = A;,. Then 
rpPAaoo.. 07 


OA 0~ C | 
AB= BA = = Al,, 


[0 00... A_I 
where A = det A. Consequently, det (AB) = A* = det (BA). 


The proof is obvious when we carry out the multiplication of A and 
B and repeatedly use Theorem 6.4.4. 
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6.4.7 Definition The matrix Bcf Corollary 6.4.6 is called the adjoint of 
A and is written as adj A. 


Example 6.19 Find the adjoint of 


mi —-lIl 07 
A=]| 0 1 1 ic 
| 
{1 2 I] 
The cofactors of the different entrics in det A are 
Ay = —I, Ars L; Ay; = ~1, 


As —I, Ass —I, Ass == l 
Therefore, 
[—1 1 —17] 
adj A = I 1 —] 


| 
L-1 -3 1) 


The adjoint is of significance in finding the inverse of a nonsingular 
matrix, as will be shown at the end of § 6.5. 


Problem Set 6.4 


1. In Corollary 6.4.6 we repeatedly use Theorem 64.4. How many 
times do we use it ? 
Prove Remark 6 4.5. 

3. Evaluate the following determinants : 


21 0 ,t 2 4 1 3 4 
(a) | 1 0 3 (bo) }2 301 (c) | 6 10 
032 > 4. 3 { 10 20 
1i11t1ti1 
321 4! ,3 8 7 6 
| | l 123 4 5 
115 29 214 17 410 2 
(d) | (e) (fy) 11 3 61015 
11619 317 68 5 8 
| 1 4 10 20 35 
33 39 8 38 19 5 3 9 
; 1 5 15 35 69 


4. Without expanding, prove that 
l yz pra ) 1 I] 


1} ozx ztxil[=!|x y 2z 


lay xty x? y? 2? 
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5. Prove that 
1 x x? 


(a2) | 1 y wl = (e— yy) —- 2) (z - x) 


N 
to 


% 
Nes 
N 


(b) I y 2x} = (x — v) (vy — 2) (z — x) 


1 oz xy 
x +a b c d | 
( | 
a x+5 c d 
(c) = (x+a+b+e+4+d). 
a b Y+ec d 
a b c x+d 
6 If «,, w,, and w, are the three cube roots of unity, then prove that 
Xi Xq Xy 
3 
Vg Xy Ag | = M4 $+ X,0, 4 x40?) 
| i 
| Ky X33; VY 


This determinant 1s called a circulant of the third order Write 
dowy acirculant of order 2 Write also its value 


7. (a) Prove that the equation of a citcle through three points (%, 1), 
(Xo, 2), and (¥5, }3) IS given by 


xrt+y x y 1 | 
xi t+yi mM Mu 3 
alt y3 X, Ye 1 
e+yi x ys 1 


(b) Determine the equation of the spherc passing through the points 
(*1, dus Z1)s (ay, J 2s Z2)s (Xs, 39 Z;), and (X4 Yas Z,) in the deter- 


minant form 
8 Solve the equation 
x +a b Cc ; 
Cc x+6b a = (Q@. 


a b x+e¢ 
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9. Without expanding, prove that 


l+a | d ] 

1 1+5 1 | ! ] l 
=abed(l + -+7+-—+4-). 

I I I+e a2 ee 

] 1 I l+d 


10. Calculate the adjoint of matrices of Problem 2, Problem Set 5.5. 


11. True or false ? 

[—cos® —sin 6 7] 

(a) In the matrix | | the cofactor A,, is —sin 0. 
|. sin O ,cos 0 _]J 

(b) There exist determinants none of whose entries is zero, but for 

which every cofactor is zero. 

(c) Ifa matrix is nonzero, then its adjoint is also nonzero. 

(d) adj (adj A) = A. 

(e) adj («/J,) = a*-/,,. 

(f) Ifadj A is a diagonal matrix, then A is also diagonal. 


6.5 DETERMINANT MINORS AND RANK 
OF A MATRIX 


Given a matrix A, we can get many smaller matrices from it by simply 
deleting a certain number of its rows and/or columns. Matrices thus ob- 
tained are called submatrices of A. 


6.5.1 Definition The determinant of a square submatrix B of A is called 
a determinant minor of A or simply a minor of A. 


Example 6.20 Let 
~1 2 3 44 


A=|;5 6 7 8 


L9 10 it 12,) 


Ti 2 34 DS er) 
Then B= | | is a submatrix of A and | 
L9 10 IIL 9 11 


A and also of B. 


6.5.2 Lemma (a) Let A be anm xX n matrix. Apply som2 elementary row 
operations to obtain a new matrix A,. Delete some columns of A, to 
get a submatrix B, of A,. The same submatrix B, could also have 
been obtained if we had first deleted the same columns from A itself 
to obtain a submatrix B and then applied the same elementary row ope- 
rations to B, 


is a minor of 
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(b) Jf B, is a square matrix (and therefore B also), then det B is equal 
to some nonzero scalar multiple of det B,. 


The proof is obvious, because of the way elementary row operations 
work, Deletion of a column or columns will not affect the result of the 
elementary row operations on the remaining submatrix. 


Part (b) is only a restatement of Remark 6.2.7. 


6.53 Theorem [f Ais anm xX n matrix, then the rows of Aare ft iff A has 
a nonzero minor of order m. 


Proof: Let A, be the row-reduced echelon form of A. Suppose the 
rows of A are LI. Then A, would contain m nonzero rows. The m 
columns containing the 1’s at the steps will also be nonzero. Delete the 
remaining columns of A, and obtain an m X m submatrix B, of A,. Ob- 
viously, B, = J,, and det B, = det [,, = 1. By Lemma 6.5.2 (b), the cor- 
responding square submatrix B of the matrix A will have the property that 
det B is a nonzero scalar multiple of det B,, which is 1. So det B+ 0. 
Thus, A has a nonzero minor of order m. 


Conversely, suppose A has a nonzero minor of order m. Let B be the 
corresponding submatrix. We shall now prove that A, contains m nonzero 
rows. Suppose, if possible, A, has a zero row. The same operations 
that reduced A to A, will reduce the submatrix B to B,. Since B, is of 
order m X m and at least one of the m rows of A; is zero, it follows that one 
of the rows of B, is zero. So det B, = 0. But, by Lemma 6.5.2 (b), det B 
is equal to some nonzero scalar multiple of det Bi, which is zero. This is 
a contradiction. Thus, all the rows of A, are nonzero. In other words, 
the rows of A aret. § 


6.5.4 Theorem The rank r of anm X n matrix A is the order of the largest 
nonzero minor of A. 
In other words, the matrix A is of rank r iff there exists a minor of 
order r which is nonzero, and every minor of order s > r is zero. 


Proof: Let p be the integer such that there exists a minor of order 
p, Which is nonzero, and every larger minor is zero. We shall tow prove 
that r = p. 

Since A has rank r, r rows of A are LI. Choose such r rows. Let B be 
the submatrix of A obtained by deleting the remaining rows. Bis an r xn 
matrix, all of whose rows are LI. Therefore, by Theorem 6.5.3, B contains 
@ nonzero minor of orderr. Hence, r < p. 

On the other hand, look at the nonzero minor of order p. This gives 
rise to a p X p submatrix B. This in turn gives rise toa p X 7” submatrix 
CofA. C contains a p X p nonzero minor. Hence, by Theorem 6.5.3, the 
rows of C are LI. This means that A contains p Li rows and so p < r. 
Thus,r =p. § 
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6.5.5 Corollary A square matrix A of order n is nonsingular iff det A + 0. 
The proof is left to the reader. 
“3 -l 27 


Example 6.21 Find the rank of A = | 0 1 —3 C examining the 


16 —1 1_} 
determinahtt minors. 
3 —1 2 3 —!1 2 
‘A| =| 0 1 —3| = |0 1 —3 =-0 
rs — 2ry 
6 —1 1 0 1 —3 
1 —3 
So the rank of A is less than 3. The minor #0 
— | ] 


So the rank of A is 2. 


INVERSE OF A MATRIX 


We are now ready to give another method of finding the inverse of a 
nonsingular matrix : 


Let A — (2.,)nen be a nonsingular matrix. By Corollary 6.4.6, we 
have 


AB = BA= Al, 
where B == adj A and A = det A. Since A + 0, we get 


1 4 
4(,2)= (x3) 4 ay. 
] 1 
ee; oe . 
Ther.fore, A“ = 5 B A adj 4 
[Ay Ayo Ant | 
Ay, Aeg Ana 

LAin Amn ++ Ann 


Example 6 22 Find the inverse of the matrix of Example 6.19. 
We have 


Ti -—-1 07 [~--1 1 —1] 
A=|0 1 14 and uj 4 =| 1 1 -] ; 
{1 2 1_] {.—1l —3 lj 


Here det A = —2. Therefore, 
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~ 2 —8/2 = 1/24 
A*=| -1]2 -1/2 1/2 |. 
L 1/2 3/2 —1 j2_) 


Problem Set 6.5 


Give explicitly the proofs of the ‘if’? part and the ‘only if’ part of 
Theorem 6.5.4. 


Use determinant minors to calculate the rank of the matrices of Pro- 
blem 1, Problem Set 5.5. 


Using determinants, prove that the matrices of Problem 2, Problem 
Set 5.5, are nonsingular. : 


Use Theorem 6.5.3 to solve Problems | and 2, Problem Set 3.5. 


Calculate the inverse by adjoit method for nonsingular matrices of 
Problem 2, Problem Set 5.5. 


True or false ? 
(a) If k-th order minors of a matrix A are all zero, then the rank 


of Aisk — 1, 
(b) If the rank of A 1s k, then every k-th order minor is nonzero. 
Ti 2 37 
1 2 
(c) In the matrix A=! 1 2 4 | the minor is zero. 
L0 0 0_J 


Therefore, the rank of A is 1. 


(d) If arow and acolumn of an n X n matrix A are zero, then the 
rank of A is less than or equal to 7 — 2. 


6.6 PRODUCT OF DETERMINANTS 


In this article we shall study the determ‘nant of the product of two 


square matrices In this connection we have the following theorem. 
6.6.1 Theorem Jf A and B are two square matrices of the same order, then 


det (AB) = (det A) (det B). 
The proof of this theorem is rather complicated. So we shall be satis- 


fied with verifying the theorem for 2 x 2 matrices. 


[oy yg | [Pu Pal 
Let A = | | and B=| 


Lae, %qeq_] L_Bar Bas 
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Then det A = 1% — %12%91 
and det B = By:Pe, — BisPas- 
We shall now calculate det (AB). Since 


is a 03743 + %y2hgr a 1Pig + MrsP ag | 
LcerBia + OaePex GerPig + Xahso_t 


we have det (AB) = (11811 + 128 21)(%a1P is + %saPea) 
— (1:Big + %1gBye)(@a1P11 + A%aaPex) - 

A merciless simplification will show that det (AB) = (det A) (det 8). 

Though we have not proved Theorem 6 6.1, we shall be using it in the 
sequel. A complete proof can be found in advanced texts on the subject. 
6.6.2 Corollary Jf A is a nonsingular matrix, then 

1 
-1\ —1 
Proof: We have AA? = IJ. 

So det (AA“1) = det J = 1 
or (det A) (det A!) = 1. 
Therefore, det A + 0 and the result follows. § 

Theorem 6.6.1 can be rewritten in the following form. 


6.6.3 Theorem (Reworded) Jf A = (a,;) and B = (8,;) are square matni- 
ces of order n, then (det A) (det B) = det C, where C = (Ciy)axn and 


n 
Cy = Z ee Pus. 
kas] 


Example 6.23 Let 
ri 0 —14 fp—-l 2a 


A=| 23 a] ma a-| 361], 
t.1 2 1_] L 15 3.4 
|" 0 —! 10 —!I 
Then det A= ,2 3 4 = 0 3 6 
| Tr, — 2r1, 
1 2 Ul rg— r, 10 2 2 
3 6 
| |= -6, 
2 2 
}—1 2 0 —1 30 
12 1 
and det B = 3 6 I = 012 1 =(-0| |=-29. 
73 


Vs + ari, 
| 


: 13 3ilrgt+ er 
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-—-2 —3 ~—37 
Aso 4B = | 11 42 15 | and 
tK 6 19 5_j 
—2 —3 -3 ey Mees ee ey ees eee 
det (AB) =| 11 42 15 a 11 42 15) = 127 0 
rs + Sr re + 5r 
619 5).  |0 10-4)" "| 0 10—4 
0 51 —3 
51 —3 
= 127 O --| = — (—204 + 30) = 174 
ry + re 10 —4 
010 —4 
== (det A) (det B). 


Problem Set 6.6 
1. In the proof of Corollary 6.6.2 justify the step “Therefore 
det A ~ 0’. 


2. If A and B are square matrices of order n, then prove that 
det (ATB) = det (ABT) = det (ATBT) = det (AB). 


3. If A is a squafe matrix, then prove that det (A") = (det A)" for all 
positive integers ». (Hint : Use induction.) 


Prove that the determinant of an idempotent matrix is either 0 or 1. 
5. Evaluate det 4, if A is a nilpotent matrix. 
6. Prove that 


La a’? 3 at+b+ec @+8h+e3 
(a2) |}1 b Bl ela tb te a+R+ea ®&+h4+e 
BGS ee G+Rt+c +h +c at + bi +c 
OzyP [yore xy xz 
(bt) |}z 0 x¥| = xy za+x% yz 
y x O zx yz x+y 
2yz— xt y x y z{? 
(c) za 2zx — y* x =|y zx 


y? x* 2xy — 2? zxyp 
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7. Prove that 


ta 
Orr 43 O13 | Ay, Aig Ais 
Gn, Ong ag! = | Any Age Aes | 
| 
X31 gq Fay ' Ay, Az, Ags 


where A,; 1s the cofactor of a,,. 


8. True or false ? 
(a) If A is involutory, then det A = 1. 
(b) If (det A) (det B) = J, then AB = J. 
(c) det (A + B) = det A + det B. 
(d) (det (cA)) (det (B)) = c(det A) (det B), where c is a scalar. 
(e) det (AB) = det (BA). 
(f) det E FR (Mg, 2). 
(g) If A and B are two square matrices such that A = C-! BC for 
some invertible matrix C, then det A = det B. 


6.7 APPLICATIONS TO LINEAR EQUATIONS 


Recall Theorem 5.8.2. The system of 2 equations in m unknowns 
ipXy 1 yaX%q +... + KnXy = Py 
21% i AaeXg over bh OenXy = Bs (1) 


uty 3 9 One Xy + woe + OynXy = By 
h.s a un‘que solution iff the mitrix A = (x,,)nx, is nonsingular, i.e. 
det A ~ 0 (cf Corollary 6.5.5). We shall now give a method, using 
determinants, of finding the solution when det A + 0. 

Let the cofactor of «,; in det A be A,,. Multiply the first equation of 
system (1) by Aj, the second by A,;, and so on, the last equation by A,), 
and add. We get 

%y(041A3_ + Og3491 + «... + Oy Any) 
+X 9(%1249) + Hegdor + ... + OneAny) 
+ Xn(O3nAra + XanAer + e+ + OnnAns) 
= ByAy, + Podar + --. + Badny 
In view of Theorem 6.4.4 and Remark 6.4.5, this equation becomes 
X, det A = ByAy, + Bydeqy + ... + BpAny 
By ag « Lin 
Bg Ogg ven ay 
= 


Bn Ong ooo Ong 


67 APPLICATIONS TO LINEAR EQUATIONS / 231 


The last equality can be seen by expanding this new determinant in terms 
of its first column : 


| By yy ag Lin 
j B. Men Mag hon | 
So 1 = Get A 


Bh Ong Sng oe a 
In the same manner, if we multiply the first equition by 4,,, the 
second by A,, and so on, the last by A,,, and add, we get 


Oy, Fra vee Ays 9-1 By Sys pea cee Lan 
] Oy, ag cee Boy g-1 Be Any att cee Aon 
xy = TG (2) 
det A |; : : : 2: : 


Any Sng «s+ Ans y—1 By Ons sta ees Onn 
for all j = 1, 2, ---, a. 
This method of solving a system of 7 equations in 7 unknowns is 
known as Cramer’s rule. This can also be derived as follows : 
System (1) can be written in matrix notation as 
Ax =b, (3) 
where A is the square matrix (a4j)nxn. % = (%1s Xu» + Xa)" 
b = (Pr, Par +» Bu)”. Since A is nonsingular, we get 
A-\(Ax) = A7'b 


or 
x= Ab. (4) 
But Ati= aa adj A - (cf § 6.4). 
Hence, 
x= j = A (adj A)b (5) 
x] ["Ay, Agi es An | 
Xs Ayy Ag + Ans “Pi 1 
= : 1 : : By 
x det A Ay. Ay ae Aa 
; : ; : LB. 
bX nan! tiAin Asn «+ Anna 
Therefore, ; 


x; = a a (BiAy + Bedey +o + BA ny) 
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Lay Ang see 8, eos Can 


j-th column 
Example 6.24 Solve, by Cramer’s rule, 


f~2 --3 17] 
Here a=] | 1 —1 
{1 —2 tj 


and det A = 1. Therefore, 


I ao _ | < ) oe 
—l —2 1 —l | 
2 —3 1 
and z= ] l O| <= —4, 


Note that if det A = 0, then A has a rank less than n and so Ax = 0 
has nontrivial solutions. In this case Ax = b may or may not have a solu- 
tion. Even if it has a solution the solution will not be unique. Converse- 
ly, if Ax = 0 has nontrivial solutions, then rank A is less than mn. So 
det A = 0. Thus, we have proved the following theorem. 


6.7.1 Theorem Jf A = (ai;)nxn, then Ax =0 has nontrivial solutions iff 
det A = 0, 


6.7.2 Remark When det 4 = 0, Cramer’s rule cannot be used. (Why?) 
Problem Set 6.7 


1. Use Cramer’s rule (if applicable) to find the solutions of the following 
systems of linear equations : 

(a) 3x+ y= 1 (b+) 2x—3y=7 () x+29 + 32=3 

Sx + 2y =3 x+4y= 1 2x — guard 

4x + 2y + 2z = § 
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(d) x—yt2z=1 (e) x+ y+2z=3 
2x + 2z = 3 2x + 2y + 22 =7 
3x + y +3z2=7 3x + 4y + 3z =2. 
2. Repeat Problem | for the systems of linear equations of Problem 1, 
Problem Set 5.8. 


3. Find the inverse of the coefficient matrix for the systems of linear 
equations of Problem | by any method, and use Equation (4) to solve 
these systems. 


4. If the coordinate axes in a plane are rotated through an angle «, then 
the old coordinates (x, y) are expressed in terms of the new coordi- 
nates (x’, y’) as 

x = x’ cosa — y’ sin « 
y =x'sina + y’ cosa. 
Use Cramer’s rule to express (x’, y’) in terms of (x, y). 


6.8 EIGENVALUES, EIGENVECTORS 


Ann X nreal matrix has been considered as a linear transformation 
from VY, to V,. The simplest type of linear transformation is the one that 
merely multiplies all vectors x in V,, by a fixed scalar, that is, 4x = Ax for 
some fixed A Now we shall discuss those situations where the effect of a 
linear transformation is simply scalar multiplication, at least in part of the 
domain space. In the process we shall see that determinants come in very 
handy. In this article we shall deal with complex vector spaces and com- 
plex scalars. Consequently, the matrices may have complex entries also. 

First, we shall take up a3 X 3 matrix: 


[Oy Og Mg | 
A= Xoax Gee Agg 
L_O 1 Aga agg _I 


Our aim is to find out whether for some nonzero vectors x = (x1, Xz, Xs)", 
it is possible to have 


Ax =x (1) 
for some suitable scalar A. From Equation (1) we have 
Ax —ix= 0, 
or 
Ax —XIx) = (A —A)x = 0 ~ Q) 
("ayy — A Aya t, | [* | 
1.¢, Oe Oleg — A Seg Xs ='0 ° 


Hi Aga Gp —A_] Lxs_] 
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Such an equation has nontrivial solutions, by Theorem 6.7.1, iff 


1 %yy — A 213 A13 

| 

Ogg yg — A tag = 0. (3) 
| S31 Ase 33 — A 


Expanding this determinant, we find that Equation (3):reduces to an 
algebraic equation of the third degree in A. Since our scalars are complex 
numbers, we are assured of three roots for this equation. Let us call these 
roots A,, Ay, and a3. For each of these 2’s, it follows that Equation (1) has 
a nontrivial solution. Denote the set of these nontrivial solutions of Equa- 
tion (1) for a given A by F(A). 

The values ,, As, and A, of A are called eigenvalues of the matiix A, and 
each vector belonging to E(A) is called an eigenvector corresponding to the 
eigenvalue 2. 

Corresponding to each A,.i= 1, 2, 3, we have a set of eigenvectors, 
denoted by £(A;), # = I, 2, 3. 

The precise definition is us follows. 


6 8.1 Definition If A is a square matrix of order n, then the values of 4 
for which the equation 
AX -= 2X (4) 
has nontrivial solutions are called the eigenvalues of A. If is an 
eigenvalue, then the nonzeto vectors x, for which Equation (4) holds, 
are called eigenvectors cotresponding to the eigenvalue A. 
Eigenvalues are also called ‘characteristic values’ or ‘proper values’. 
Similarly, the terms ‘charucteristic vectors’ and ‘proper vectors’ are also 
used. 
By Theorem 6.7.1, it follows that eigenvalues 4 are simply the roots of 
the algebraic equation 
det (A -- AJ) = 0. (5) 
Equation (5) is called the characteristic equation of the matrix A. 
det (A — Al) is a polynomial in d and is called the characteristic polynomial 
of the matrix A. Note that this polynomial has degree n. Hence, there 
can be at most a distinct eigenvalues. 


Example 6.25 Let 


Tl —1 29 
A=| 0 10}. 
Li 2 1 


To find the eigenvalues of A, we solve 
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1 ne oe 
This gives 
(1 — ay — a)? 4 (--2)) = 
OF (1 — a)Q? — 20 -- 1) =0, : 
i.e. A=1, 14+ 72, I- v2. 


So the eigenvalues of A are 
Ay =s 1, Ay == | -| /2, Ay = | _— “/ 2. 
To find E(A,) = E(1), we write 


mh —-t 27 [x1 [Xe | rio O77 fx,7 
0 1 0 nm [otfa et] o to, x, |, 
| | 
[1 2 1} Lx, J Lx; J 10 0 TL} tix J 
Oo -F 27) x7] fr Oo7 
| ! 
i.e. Oo O 0 | ee | ) 
I ) | | 
[1 2.02). (erg [|.90 | 
or - x, + 2xg= 0, ay -| 2x, = 0. 
This gives x, = 2a, and x, = 2x;. The eigenvectors corresponding to 


the eigenvalue | 21e therefore of the form ( 4.3, 2x5, 3), Where x3 % 0. 
Therefo'e, 


£(1) a [(--4, 2, 1)]\{9} . 
To find EQ.) -: EC) + 1/2), we write 


io —-1 2°) [xy] [ox] 
0 1 0 | | X, =(Lt v2) 
i | P l 
LI 2 Pel xg! L.x, J 
This gives 
[—-v2 -1 2 1 — x | [077 
| | 


e | 0 —4/ 2 0 Xz —= | 0 ° 
L. 1 2 ~vV2_} 1x3 _J LO _J 
Solving this, we get 
EQ + +/2) = [(v2, 9, 1)K{0} . : 

Similarly, EQl—+/2) = [(— v2, 0, 1)]\0} . 

6.8.2 Theorem If is an eigenvalue of an n Xn matrix A, then the set 
K, = E(a) U {0} is a subspace of the vector space VS of n-tuples of 
complex numbers. 
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K, is called the eigenspace corresponding to’, The proof is left to the 
reader. Note that XK, is the set of all solutions of the equation Ax = Ax, 


It is clear from Theorem 6.8.2 that if v belongs to E(A), then every non- 
zero scalar multiple of v is also a member of E(A). Therefore, if 
v, €& E(a,) and v, € Eq), then {v,, va} is LI, because neither is v, a non- 
zero scalar myltiple of v, nor is v, a nonzero scalar multiple of y,. This 
idea does not stop here. It can be further extended. More precisely, we 
have the following result. 


6.8.3 Lemma Let A be a square matrix of order n having k distinct 
eigenvalues 24,43, Ay» Let v; be an eigenvector corresponding to 
the eigenvalue i;, i = 1,2, ...,k. Then the set {v,, Vo, «+, Vz} is LI. 


Proof: We shall prove this lemma by induction. The lemma is true 
fork = 1, ie. {v,} is 1, because vy, 4 0. Now suppose that it is true for 
k = 1, i.e. {Vj Vey -» » Vp} iS LI. We shall now prove that it holds also for 
k=r- 1, i.e. {¥,, Ve, ---, Yep Veey} iS LI. Let 

OV QV nee bf Oe Oren = 0. (6) 
Th erefore, A(ayVy + %qVqg - oes + app + Opie) = 40 = 0, 
1.€. 

OLAV, + OgAgVg bo oee  @eARVp  OrrAntyMeey = O', (7) 
because 4 is linear and Av; = A,vy,. Multiplying Equation (6) by ,,, and 
subtracting from Equation (7), we get 

0y(Ay — Arta)¥, + Oa(Ag — Anta )Va + «0. bt ate(Ap — Aria), = 0. 
Since {v,, Va, -. Vp} iS LI and Ay # Ags, i = 1, 2, 3, ..., 7, We get a, = 0 
= @, = .. =a, Substituting these values of «,’s in Equation (6), we get 
Oneetr = 0. Therefore, «+, = 0, which completes the proof. § 

We shall now prove a fundamental property of eigenvalues and eigen- 
vectors, Which will be useful in the further development of the subject. 
6.8.4 Theorem Let A be a square matrix of order n having n distinct 

eigenvalues 2, Ag, ++, An. Let v, be an eigenvector corresponding to 

the eigenvalue d,,i = 1,2, .--,m. Then the set {v,, Va, +, Va} is a 

basis for the domain space of A. The matrix of the linear transfor- 

mation A with respect to the basis {v,, Ve, ++-, Va} is 


[A 00... 07 
0 a0 .. 0 
00... 0 


10 0 0 ww. Apt 


Proof: The set {v¥1, Va, «+, Va} is LI by Lemma 6.8.3. Since the 
domain space is n-dimensional, it follows, by Theorem 3.6.7, that the set 
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{¥1, Yay «**) Yn} is a basis for the domain space of A, For the second part 
of the theorem, note that Av, = d,v, = Ov, + Ov, +... + Ov, + Ay, + 
Ovi, +--+ + Ova. Thus, the i-th column of the required matrix is 


(0, 0, «5A, +», O)7. 


i-th place 
Hence the theorem. §j 


Im such a case the matrix is said to have been diagonalised. 


Problem Set 6.8 


1. Determine the eigenvalues and the corresponding eigenspaces for the 
following matrices : 


3247 
3 1 [oO -17] {oO 31] 

(a) | | (b) | | © | | (d) 202 | 
L6 2] 1 OL! & 


: : - 1} 
L42 3_] 
(3 2 107 
~1 0 07 (“O i 2] 
| 0 1 0 ] 
e) | 2 1 0 f) |} i O « | (g) 
(e) ( | ai, tt 
L3 2 0) Li i 0_] 
{00 O 3.) 
2. Diagonalise the matrices of (b), (c), and (g) in Problem 1. 
3, Find the characteristic polynomial of the matrix 


[ 1 0 0 077 


L+¢-i x —il | 
Diagonalise this matrix, if possible. 
4, If) is an eigenvalue of the matrix A, prove that 
(a) A® is an eigenvalue of A? 
(b) A* is an eigenvalue of A” 
(c) ad is an eigenvalue of «A, wheie « is a scalar 
(d) g(a) is an eigenvalue of g(A), where g is a polynomial. 


5. If x is an eigenvector of A corresponding to the ecigenvalve A, prove 
that 


(a) x is an eigenvector of A* corresponding to the eigenvalue 4* 
(b) x is an eigenvector of g(A) corresponding to the eigenvalue g(a) 
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6. Prove that 4 = 0 is an eigenvalue of the matrix A iff A is singular. 


7, If is an eigenvalue of the matrix A, prove that 
(a) A is also an eigenvalue of AT 
(b) 1/A is an eigenvalue of A™', if A js nonsingular. 
8. If x is an eigenvector of A corresponding to the eigenvalue 4, prove 
that 


(a) x need not be an eigenvector of A’ corresponding to the eigen- 
value A 

(b) xis an eigenvector of A-!(if A is nonsingular) corresponding 
to the eigenvalue 1 /A. 


9. Prove that the eigenvalues of a triangular matrix are its diagonal 
elements. 


6.9 WRONSKIANS 


In this article we shall use determinants to discuss dependeuce anb 
independence of functions. These ideas help in an understanding ot the 
theory of ordinary linear differential equations. First, we shall define the 


Wronskian of functions. 
6.9.1 Definition If y,,¥., -,¥n. are m functions in ‘47 (J), then the 
determinant 


V(x) Yo(x) oe Yn(X) 


¥;(x) yx) vee ¥n(X) 
W(x) = 


Vix) yo M(x) ee yal “Y(x) 
is called the Wronskian of 1, yo, +», Yn at x, and is denoted by 
Wiys(x), Yo(x) .... Yn(X)]. 
Note that the Wronskian is a function of x. 


Example 6.26 The Wronskian of the functions x ard cos x is ° 


x cos xX | 
W[x, cos x] = == —X sin x — COSx. 
1 —sin x | 
The linear dependence or independence of the functions y,, Var --+9 Vn 
plays an important role in the solution of an ordinary linear differential 
equation. The following theorem tells how the dependence or indepen- 
dence of functions y,, y,, -- , ¥, is related to their Wronskian. 


6.9.2 Theorem Let yi, Ys, .... Wn © EF (1), and let W(x) be their 
Wronskian, 
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(a) Uf there exists x, € I such that W(x,) # 0, then y1, Ys, 
Li over I. 


(b) If there exists xy € I such that W(x.) = 0 and if ys, Yas «5 Yn 
are solutions of the differential equation 

ay” + ay" 4... tary +a,y =0, (1) 
where doy Gy, +, An © CS WD, then yy, Ye, +, Y, are LD over J. 


(Cc) Tf Vis Vey +++) Vn Gre Solutions of Equation (1) and are 1 over I, 
then W(x) never vanishes on I. 


cory Vu are 


(d) Lf V1, Vas »--s Yn Gre Solutions of Equation (1), then either W(x) 
= 0 over I or W(x) has no zeros in I. 


Proof: (a) Since W(x.) 4 0, W(x9) considered as a square matrix 


is nonsingular by Corollary 6.5.5. Hence, by Theorem 5.5.2, the column 
vectors 


v,(Xo) = (y.(Xp), Vl%Xq), seey Vers), j= I, 2, o hh (2) 
are Liin V,. Therefore, y,, Ye, «+, Yn are Lt over /, by Lemma 4.9.5. 
(b) If W(x,) = 0, the columns of W(x,y), namely, v.(x%9) == (¥.(%p); 


V(Xo)> e+, Vs'"—'(xQ)), i = 1,..., 4, are LD in V,, by Theorem 5.5.2. There- 
fore, there exist scalirs C,, C,, ---, C,, not ra kal such a 


Cy (Xo) + Cryve(Xo) + - Cila(%o) = 
This means 
Crys" (Xo) + Cove! (x9) + oe F Cadn (Xo) =0, k = O, 1, 2, «, (2 — 1), 
(3) 
for at least one scalar C; not zero. Consider the linear combination y = 
Cia + Cova toe + Cyayn. Since yy, vas -* » Yn are solutions of Equation 
(1), y is also a solution of (1). But by Equation (3), we have 
Y(Xq) = Y'(Xo) = ve = YW N%q) = O- (4) 
Thus, y is a solution of Equation (I) and satisfies the initial conditions (4). 
But the zero function also satisfies Equation (1) and the initial conditions 
(4). Hence, by Theorem 4.9.2 (existence and uniqueness), y(x) = 0 for all 
xin I. 
Thus, C,y,(x) + Coye(x) + + + Cyy,(x) = 0 for all x € 7 and at 
least one C, ~ 0. Therefore, y;, 2, -- » Ya are LD over J. 
(c) This is the contrapositive statement of (b). 
(d) It follows from (b) and (c). § 


69.3 Theorem Jf y,, y, are solutions of 
ay’ +any' +ay=9, (5) 
where ao, a, and a, belong to & (J), and a, is nowhere zero cn I, then 


at x 
Wii), y= Ce : (6) 
Proof: y, and y, are solutions of (5), Therefore, 
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IgV, + ay + a = 0 


and Ay’, + ary, + aey3 = 0. 
rs ; , 
Also Wy1, Ya] = . le Vive - 
Ya Je) 
dw :. : 4 ” oe * yf 
So a eee Vo t+ V2 ~ VyV2 — Via = ViVa — Vids 
_ _ a, ia as ot _ Qa, a a 
= y: ( a V2 ay y) v( ay y1 Gy y:) 
ye eee ene. 
sa a, (Yee, — Yi") Qo W, 


Hence, on integration, we obtain 
oe | a,(x) ,. 
WIy, (x), ¥2(x)] -= Ce a(x) ’ 
where C is an arbitrary constant. § 
6.9.4 Remark The foregoing result can be extended to a differential 
equation of the n-th order. Here we state the gencral result. If 
Vis Yes ** » Yn aFe 7M Solutions of the z-th order normal linear differen- 
tial equation ayy 4 ay") + ... +- a,y = 0, on ah interval J, 
a (Oy 
then W[yi(%), Yo(*), J n(*)] - Ce ays) (7) 
Equations (6) and (7) are known as Abel's formulae. 


Problem Set 6.9 


1, Use the Wronskian to prove that the following sets of functions are 


LI over J : 
(a) e*,e*saxXb; I any interval 
IE eer Masher dual ae Pe 

M,, Mz, -.-, Mz, all distinct ’ any anleeya 
(c) 1, x, x?; I any interval 
(d) 1, x, x7, ..., x71; TI any interval 
(e) e*, sin 2x; J any interval 
(f) exe” : I any interval 


(g) e~* sin Bx, e** cos Bx; J any interval 
(h) Inx,xInx; I = (0, 0). 
2. Use Abel’s formula to find the Wronskian of the linearly independent 
solutions of the following normal linear differential equations : 
(a) y"'— 4y' + 4y = 0 
(b) y’ + 2xy = 0 
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(c) (1 — x*)y” — 2xy' + 2y = 0; y,(0) = y{(0) = 2, 
y(0) =—y,(0) = 1 
(d) xy" — 3xy' + y = 0; y,(—1) = yi(—1) = 2, y(—1) = 0, 
y(—1) = -1. 
3. What is the value of C in Equation (7) if ),, ys, ..., ¥, are LD ? 


6.10 CROSS PRODUCT IN », 


In this article we shall discuss the product of vectors in V3, mentioned 
in § 2.3. 
6.10.1 Definition If u = (a,, a, @;) and v =- (b,, b., 63) are two vectors 
in V;, their cross product, written as u X vy, is defined as the vector 
| % a3! | ds "| \* a, 
|b, by, | bs Pil |b: bal J 
Since the cross product is a vector, it is also called vectur product. 
In simplified form Definition 6.10.1 says 
(ay, G3, 43) X (by, Bs, 53) ~ (2,5; — @ybz, ashy -  a1b5, 4,5, - ab,) . 
If we use the unit vectors i, J, kK, we obtain 
(a,i + a,j + agk) X (Di + bj 4+ 53k) 


ux v— 


Qe a; a; ay, . a, a, | 
es i | J + » 
b, 5! b, by b, by | 
which is easily remembered in the determinant form 
i oj ik 
Gd, dy ay|- (1) 
° b, b 4; 


To obtain the cross product we expand (1) in terms of the first row as if 
it were a determinant. Note that (1) is not a ‘pukka’ determinant. 
From Definition 6.10.1 it follows immediately that 
ixj=- k, jxk= it5 kxi~x J 
jxi=-k, kx j= i Kk = —-j, 
and ixi= O=jfxj= &XK. 
"Note that the cross product is a binary operation on V3. 
Example 6.27 (1, 2, —1) x (0, —1, 3) 


(33h eee aD 


(5, —3, —1). 


I 
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6.10.2 Theorem (Properties of cross product) Let u,v, w be any three 
vectors in V,. Then 


(a) uxv= —(v X wu). 
(b) ux@Wv+w)=uxv+uxX w. 
(c) For« € R,au X v= a(u X v) =U X ay. 
(d) u- (u xX v) = 0, andv - (u X v) = 0, i.e. u xX v is orthogonal 
to both u and y. 
(e) Juxvi®== [ult v[?—|uerv]* 
Since the proofs are straightforward, we shall prove only (e). 
Proof of (e): Let u = (a, a,, a3) and v = (8,, by, bs). Then . 
lul*{v[?—|u-v|* 
= (qj + a; 4- a)(b? + bs -+ b§) — (a,b, + a,b, + a,b)" 
= ¥ aj(b} + b%) — 2 a,b,aab, 
= © (a?b? + atbi) — 2 2 a,b,a,b, 
= £ (a,b, — azb,)* 
= [uxv|’. § 


6.10.3 Corollary Jf 6 is the angle between two nonzero vectors u and v in 


V3, then 
luxv|]=|ul| [v] sind. 
Proof: We have 
u-v== [ul |v] cosO - (cf Definition 2.3.3). 
Hence, from (e) of Theorem 6.10.2 it follows that 
luxv]*?=|[ul*?|]v]2?—|ul?|v]? cos? 6 
= |u|*|v|*sin?@. 
So [uxv[= |u| |v] sin®,sinee0 COQ. § 


Note that |u| |v {| sin 9 is the area of the parallelogram formed by 
vectors u and v. Hence, | u xX v | represents the area of the parallelo- 
gram formed by u and v. 

DIRECTION OF u x v 


Given two vectors u and v, we have just proved that 


(i) |u xX.v| = |u| |v {sin 8, where 6 is the angle between u and », 
and 


(ii) « X v is perpendicular to both u and v and therefore to the plane 
containing u and v. . 
(i) specifies the magnitude of u x v, but (ii) leaves us to decide which 


of the two directions perpendicular to the plane of u and v is the direction 
of u xv. We shall now settle this question. 


We start from the ordered triple of vectors (i,j, k). ‘Any ordered 
triple of linearly independent vectors (u, v, w) is said to be a positive triple 
if, by gradually changing the directions of u, vy, w byt without making them 


6.10 CROSS PRODUCT IN F, | 243 


linearly dependent (i.e. without making any of the vectors cross the plane 
of the other two), we can bring them into coincidence with the directions 
of i,j, and k. Otherwise it is said to be a negative triple. 


Examples of positive triples are 
(i, A k), Gs k, i), (k, é, j). 
Examples of negative triples are 
i,k), (kj), Gk,J). 
6.10.4 Lemma Three linearly independent vectors u = (a, Go, Gg), 
v = (5, b,, 53), Ww = (C1, Cz C3) form a positive triple iff 
4, a, ag! 


b, be — 


Cy Cg Cg, 


Proof: A positive triple, which actually coincides with the direc- 
tions of i, j, k, 1s of the form 


u- di, y= Dj, w = ck, 
where a, 5, and c are positive. So the determynant of the lemma is 
| a 0 0 
0 b 0| = abe ’ 
0 0 c¢ 


which is positive Now any other positive triple is obtained by gradually 
changing the directions of u,v, and w, but without ever making them LD. 
This proces; continuously changes the value of the aforesaid determinant, 
but without ever making the determinant take the value zero (since such a 
value will correspond to making u, v, and w LD). Hence, every positive 
triple has a positive value for this determinant and vice versa. g 

Now we can see that u x v, as defined, has that direction perpendi- 
cular to the plane of u, v that makes u,v, u X v a positive triple; for the 
determinant of Lemma 6 10.4 now becomes 


ay ay a; | 
b, bs bs ’ 
a,b, — a3by a3b, — aby a,b, — 4b, 
whose value is 2 (a,b, — a,b,)?, which is positive. 
Thus, u X v is given by Figure 6.1. 
In other words, if the angle between u and v is 9, 
0 < 6 < x, then the direction of u x vis the one in 


which a right-handed screw would move when rotated 
through the angle 6 from wu to y. 


FIGURE 6.1 
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6.10.5 Definition If u, v, and w are three vectors in V;, u + (v x w) is 
called the scalar triple product of u, v, and w. 

Note that, even if we remove the parentheses in Definition 6.10.5 and 
write wu: v X win place of u - (v X w), there cannot arise any ambiguity, 
since (u + v) X wis meaningless. (Why 7) 

6.10.6 Theorem (Properties of scalar triple product) Let u = (a,, ag, as), 
v = (b,, b,, by), and w = (C1, Ce, C3) be three vectors in Vz. Then 
‘A, @, ay 


(a) u-vxXw=.b, by byl. 


Cy Cy Cy 

(b) wu - vx weuxv: W=v -wKXu=zvxw: 4 
=Ww-uxvoe=wrxu-v. ~ 

(c) | u- v X w| represents the volume of the parallelepiped formed 

by the vectors u, v, and w. 


_ Proof: (a) Using the definitions of dot and cross product, we 
haveu:-vxw 


b, bs | b, b, { b, by 
= Qa, | ay +- ay 
| Cg Cg Cs Cy Cy Cy 
a @, a, ! 
= b, »b, b, | (by expansion of the determinant in 
| terms of the first row). 
Cy Cg Co | 
Qa, @ a, 
(b) u-vxw=|b, b Ds 
C, Cg Cy 
b, by bs 
= 1¢, C, ¢s|(by two interchanges of rows) 
a; ag as 
=v -wxru. 
Similarly,y- wxu=w-uxy. 
Thus, “ur-vyvexewoa=v- wxXxu=w-uxy. 


Since the dot product is commutative, these are also equal tov X W- u 
=wxXu-vo=uxv-: w. 
(c) If one of the vectors is zero or v X w = 0, the proof is obvious. 


We therefore assume that none of these vectors is zero and so also 
yx ws Q@. 
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Hence, the vector v x w is perpendicular to the plane determined by 
the vectors v and w (cf Theorem 6.10.2 (d)). So either v x w or —(v x w) 
makes an angle ¢ < 7/2 with u, as shown in Figure 6.2, 


FIGURE 6.2 


So |[u:-vxw|= [ul [vx w| cos¢d 

(lu| cosd) |v x w| 

= (height of the parallelepiped formed by u, v, and 
w) x (area of the parallelogram formed by v 
and w) 

= volume of the parallelepiped formed by uy, y, 
andw. § 


6.10.7 Corollary u- v X w= 0 iff u, v, and ware LD. 
Proof: From the proof of part (c) of Theorem 6.10.6, it follows 


l 


that 
lul |v xw]| cos¢ 
ful |v] |wl sin9cos¢. 

Hence, u - v X w= 0 means one of the three vectors is 0 or sin® = 0 
or cos ¢ = 0. If one of the vectors is 0, then u, v and w are LD. If 
sin 9 = 0 or cos ¢ = 0, then the three vectors are coplanar and hence Lp. 
Sou - v X w = 0 implies that the three vectors are LD. The converse is 
obvious. § 

We shall now consider two important applications of the cross product 
to geometry. ' 

(i) Vector equation of a plane through three given points P,, P,, Py in 
space : Let Q be a point in the plane P, P,P, (see Figure 6.3). The vectors 


lu -vxw 
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——jr —> 
P,P, and P,P, lie in the plane. The problem now reduces to finding the 


0 


FIGURE 6.3 


equation | of a a_ plane through P, and perpendicular to the vector 
N= P,P, x P,P,. Hence, the required equation is P.O - N= 0, 


— —> —> 

i.e. P,Q - (P,P, X P,P,;) = 90. (2) 
This equation is satisfied by all paints OQ on the required plane and by no 
points off the plane. 


If P,; P., and Py; are (x, Vis Z1) (%; Yes Za), and (x3, V3 Z3) respectively, 
then Equation (2) becomes 


Xx —X%, YryYy FY, 
Xg—X% Va MN 2 -y | =O. 


X3 —%q Ys— Ya 2% — % 
Example 6.28 The equation of the plane through P,(0, 0, 0), P,(1, —1, 1), 
and P,(2, 1, 2) is 


x yz 
1 —1 1);=0, 
| 2 1 


Le. xX — z= 0. 

(ii) Shortest distance between two lines: If we have two lines in a 
plane, then either they are parallel or they intersect. On the other hand, 
two lines in space can behave in any one of three ways: (a) they are 
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parallel or (b) they intersect or (c) neither are they parallel nor do they 
intersect. In case (c) they are called skew lines. Let L, and L, be two 
skew lines (See Figure 6.4). 


lg 


FIGURE 6.4 
Let P;, Pr Q1 be ne points on L,, and P,, Q, two points on L,. The 


vector P PO, x P.O, i is perpendicular to both L, and L,. The scalar pro- 


jection of P, Py qn this perpendicular is the required shortest distance 
between L, and L,. It is given by 


[PP - PQ, 1 Fes! 
——pP ee 


| P,Q: x P.O, | 
Example 6.29 Let the two lines be 
eed. Vee X*-3 _ y-2_72+4 
Beg ag ge ON Aa pe gg 


Since L, is parallel to the vector (3, 2,5), and Ls is parallel tc the 
vector (1, 2, 2), the vector N = (3, 2, 5) x (1, 2, 2) is perpendicular to 
both L, and L,. We can take P, as (1, 2,1) and P, as (3,2, —4). 
Hence, the shortest distance between L, and L, is 


| (2, 0, —5) : (3, 2, 3) x (1, 2, 2) | 
| (3, 2, 5) * CI, 2, 2) | 


20 —5 

=|} |3 2 5 + VB +I +16 
12 2j 

= | —12 — 20| + 1/53 

ee 

/53 


6.10.8 Remark The method in Example 6.29 fails in cast the lines Z, and 
L, are parallel. (Why 7) In this case let P, and Q, be two points 
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on L;, and P, a point on L, (Figure 6.5). Then the scalar projection 
—> 
of P,P, on L, gives 
——> —> 
Eo | PiPs - P,Q, | i 
—_——> 
| P 191 | 


FIGURE 6.5 
Hence, the (shortest) distance p between ZL, and L, is given by 


nd) 


= — | PiP, > P,Q, |? 
| PP, |? - =a 
| Pid, | ? 
—> ——> 
| P,P. x P,Q, | 
_--—> 
| PQ | 
Problem Set 6.10 


(cf Theorem 6.10.2 (e)) 


1. Evaluate u x v for the vectors u and v in the following : 
(a) u=itjt+khv=ai-Ytk 
(b) u=i — 2k,v = 2j + 7k 
(c) u = (1, 3,0), v = (2, —1, —1) 
(d) u = (—1, 2, 3), v = (1, 1, 2). 
Prove that 0 x v = 0 for every vector v in V3. 
3. Prove the distributive law u x (v + w) = (wu X vy) + (u> =w) and 
verify it for the vectors u, v, and w in the following : 
(a) u=i-Ytrkv=J—j,w= 2+ jf — 4k 
(b) u = (1, 2, 3), v = (3, 0, 1), w = (2, 4, 5) 
(c) u = (—1,1,2), v = (1, —1, —1), w = (4, 2, —3), 
4. In the discussion of direction of the vector u x v we have taken 
0<6< 7. What happens when 0 = 0 or 8 = x? 
5. Determine whether the vectors u x v and w lie on the same side of 


10. 


13. 
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the plane containing the vectors u and v for the vectors u, v, and w 
in Problem 3. 

Find the equation of the plane passing through the three points 

(a) A(1, 2, —3), B(3, —1, 1), and C(2, 1, 1) 

(b) A(I, 2, 3), B(3, 0, 1), and C(2, 4, 5) 

(c) A(1/2, 1, —1), B(1/2, —1, —1), and C14, 1/3, —3). 
Prove that for vectors u, v, and w of V, 

(a) (uXvxw=(u-: wy—(V- wu 

(b) ux (v xX w) - (u- why -(u- vw 

Evaluate the product 

(a x b) X (ce X a) 

of the four vectors a, 6, c, and d of Vs. Prove that this 1s a vector in 
the plane of a and 3b as well as of c and d. 


Find the shortest distance between the skew lines 


x—2 yt =]—zandx =y —2z. 


3 2 
Find the equation of the plane containing the line 
x—-2 yt! , . 
oman aaa e 
and parallel to the line x = y = 2. 


Show that the line 

L: x +1 2d 2 + 2 

2 2 3 

is patallel to the plane 

P: 2x — 4y4°2z=3, 
and find the equation of a line lying in the plane P and perpendicular 
to the line L. 
Find a plane through P(1, 2, 3) and perpendicular to the line of 
intersection of the planes 2x + 3y — z = land 3x—y—7= 4. 
Find a plane through the points P(1, --1, 2) and Q(2, 0, 1) and 
perpendicular to the plane 3x — 4y + z = 0. 


Chapter 7 


More Matrix Theory 


In this chapter we shall discuss some miscellaneous topics to give the 
reader a glimpse of what lies beyond. The intention is not to give an 
exhaustive coverage but to further our knowledge by giving a brief account 
of the following topics : 

(i) Similarity of matrices; 

(i1) Inner product spaces; 

(it) Orthogonal and unitary matrices; and 

(iv) Application to reduction of quadrics. 


7.1 SIMILARITY OF MATRICES 


The central idea here is to find out the effect of working with different 

bases in a finite-dimensional vector space V. Let two ordered bases 
F= {u, Ug, s°*5 uy} and G ={Vy, Vay ooo Vat 

be given in V. We pose the following questions. 
Question 1 Given a vector x € V, what is the relationship between its 
coordinate vectors [x]r and [x]g ? (Recall Definition 3.6.10.) 
Question 2 Given a linear operator 7: V — V, it has different matrices 
when referred to the different bases F and G. What is the relation bet- 
ween these matrices, namely, (7: F, F) and (T : G, G) ? . 
Question 3 Given a coordinate vector (a, a, ---, &), We can construct 
two different vectors 


n n 
x= Lau and y= 2 a, 
i=] a | 


in V. What is the relation between x and y ? 


Question 4 Given an n Xn matrix (cy) of scalars, we can define two 
linear operators R and S by 
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a R 
R(u;) = % Cuts and S(v;) ae 2 Cua j= I, 2, 000 A 


What is the relation between R and S ? 


Essentially, these four questions can be unified by asking for the rela- 
tion between 


(i) two coordinate vectors arising from the same element x of J: 
(i1) two matrices arising from the same linear operator on V; 
(iii) two vectors in V arising from the same coordinate vector; and 
(iv) two linear operators on V arising from the same matrix. 


In order to answer these questions we construct the important linear 
operator A on V, which transforms the basis F into the basis G. In fact, 
A:V -— Vis defined by A(u,) = vi = 1,2, -.,”. Denoting the matrix 
(A : F, F) by (a,,), we can write the definition of A as 


n 
v, — A(u,’ = Fa 0,4, J = Pe eer (1) 


n 
Note that A is one-one, since, if x = 2 a,u,, then Ax == 0 gives 
i- | 


n n n 
0- A(z a,u,) = 2 4,A(u,) = 2 av; 
i= | i=1 i=l 


or a, = 0 for alli = 1,2,.-,”, ie x = 0. Thus, A is a nonsingular 
linear transformation and so («,,;) 18 a nonsingular matrix. This matrix is 
called the matrix of change of basis from the F-basis to the G-basis. 

These four questions can now be respectively answered by the follow- 
ing four theorems. 


7.1.1 Theorem Letx GV. Let [x]r and [x]¢ be the coordinate vectors, 
written as column vectors, of x, relative to the bases F and G, respec- 
tively. Then 

ixle = (a)[*]e . (2) 
nhere the matrix («,;) is defined by Equation (1). 
Proof: Let 
{x]r = (a, Fg, wees ay)? and [x]e = (8, Be, acy | B,)? . 
Then > cat =x= ; By; = ; B,A(u;) 


= 2 Py 2 au, = 2 (2 Bya,,)ty « 
ij of tj 


Since the u,'s are LI, it follows that 
“= 7 ote i=], 2, very M, 
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Tay “] lB, 7) 
ty Bs 
i.e. = (%4) 
ae |B. J 


‘ This proves the theorem. §f 


7.1.2 Theorem Let 7 be a lineur operator on V. Let (1: F, F) be the 
matrix B = (8,;) and (1: G, G) be the matrix C = (y,;). Then, with 
(«,3) defined as in Equation (1), 
B(«,,) = (a,,)C. (3) 
In other words, 
B= (x.)C(o,,) a (4) 
Proof: We have 
T(u,) = 2 B,,u,, and T(v,) = 2 YuYs j=l, 2, -.., m. 
t 


Now, for each j = 1, 2, ..., n, we have 
T(v,;) = T(A(u,)) , (where A is defined by (1)) 
= T2anjtte) ’ (again by (1)) 
= Lap T(uy) = ap, (28,21,) 
k k i 
= 2(2B 20K); - (5) 
ik 


On the other hand, for each j = 1, 2, ---, a, 
T(v,) = 2Y nave = es (uy) 


= 2Y eythane (by (1)) 
= 2 (Lae Yes) Us « (6) 
ik 


Equating (5) and (6) and observing that the u,’s are LI, we get, for each 
i, j= 1, 2, --.,n, 

LBindes = LoaYes 

k k 


This gives Equation (3) and proves the theorem. § 

7.1.3 Theorem If (0, %, -:-, %,) is a given coordinate vector and %»= 
Lau, Y = La,y,, then the two vectors x and y are connected by the 
i i 
relation 

Ax =y, (7) 

where A is defined by Equation (1). 
Proof: Since A(u,) = v, for alli = 1, 2, ..., n, it follows that 
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Ax = A(2a) = 2a, Aus) = La,V, = Jy: | 
i 


7.1.4 Theorem Let (c,;) be a gi ven n X n matrix, Define linear operators 


R and S by 
R(u;) = Xe and S(v;) = Ley, j = 1,2, ..., 7. 
Then 
SA = AR. (8) 
In other words, 
S = ARA“, (9) 


where A is defined by (1). 
Proof: We have, for each j = 1, 2, ..., n, 
(SA)(u;) = S(A(us)) = S(vs) 
= 2C15V5 a Le,,A(u,) = A(Ze,,u,) 
8 é g 
== A(R(u;)) = (AR)(u;) . 
Hence SA == AR. § 
Equations (3), (4), (8), and (9) provide the motivation for the f: llow- 
ing definition. 
7.1.5 Definition (a) Two n xX n matrices B and C are said to be similar 
if there exists a nonsingular matrix P such that BP = PC or 
B= PCP, 


(b) Two linear operators S and R on V are said to be similar if there 
exists a nonsingular linear operator A on V such that SA = AR or 
S = ARA-“, 


In the light of this definition the answers to Questions 2 and 4 can 
now be briefly stated as: The matrices or the linear transformations in 
question should be similar 


Let us now look at a comprehensive numerical example, which illus- 
trates Theorems 7.1.1 to 7.1.4. 
Example 7.1 Let V = V;. Consider the ordered bases 

F = {(0, 1,1), (1, 0, 1), (1, 1, 0)} 
and G = {(—1, —2, 1), (1, 3, —1), (0, —1, 2}. 
(a) Given x = (1, 1, 1), verify result (2). 
(b) Given a linear operator T': V; > V; defined by T(x1, 2, %3) = 
(x, + Xa, X, + 2Xe + Xg, Xq — X31), verify result (3). 
(c) G.ven the coordinate vector (4, 5, —1), verify result (7). 
(d) Given the matrix 
fr 1-1 07 


a) = 0 1 2 ; 
° { —-1 -—2 —-lI_J 
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verify result (8). 

First, we have to construct the matrix («,;) defined in Equation (1), 
corresponding to the linear transformation A: V, — V, given by 

A(0, 1,1) = (—1, —2, 1), A(1, 0, 1) = (1, 3, —1), ACI, 1, 0) 


= (0, —1, 2). 
So we have to find «,,’s such that 


a,(0, 1, 1) + ei (1, 0, 1) 4.5 a3;(1, I, 0) ae (—1, ~—2, t) 
&9(O, 1, 1) + Oeg(1, 0, 1) + oge(1, 1,0) = (1, 3, —1) 
@4(0, l, 1) + a,(1, 0, 1) + a,,(I, 1, 0) = (0, —I, 2) . 


In other words, we have to,solve the following three systems, each of 
three equations in three unknowns : 


On.+ B+ y=-—1;( 1] O 
a+OB+ y=-—2!] 3] —1 


a+ §6+0v,= 1/-!1 2% 
The matrix for these three systems is 


ro1!l -1 1 #0 
101 -2 a |. 


Li1 0 1 —1 2_| 
Applying the row reduction process to this matrix, we get 
cm1 00 0 + #41 


So (x45) = 


(a) Let [x]r be (@,, 2, «,)7. Then 

(1,1, 1) = «,(0, 1, 1) + «,(1, 0, 1) + «,(1, 1,0). 
From this we get «, = 1/2 = a, = a,. 

Let [x]e = (P1, Ba, B,)?. Then 

(I, l, 1) ta B,(—1, —2, 1) + B,(I, 3; —1) + B,(0, —i, 2) » 

which gives f, = —1,6, = 0,6,= 1. Thus, 
[x]r = (4, 4, 4)" and [x]e = (—1, 0, 1). 

We have now only to check 
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~ 37] ~ oO ¢ $7 F=-19 


aril4 aS 


which is easily verified. 
(b) We have to compute the matrix B= (7T:G,G) = (8,). First, 
observe that, from the hypothesis, 
T(0, 1, 1) = (1, 3, 1), TU, 0, 1) = (2, 2, —1), and 7(1, 1, 0) = (1, 3, 0). 
The scalars §,,’s then satisfy 

(i, a; 1) = B,,(0, I; }) + B.(1, 0, 1) + B,,(1, 1, 0) 

(2, 2, —1) = Bx2(0, 1, 1) + Bga(1, 0, 1) + Bga(1, 1, 0) 

(1, 3, 0) = B,,(0 1, 1) + Bas(1, 0, 1) + Bga(I, 1, 0) . 
To find the B,,’s we have to solve three systems, each of three equations in 
three unknowns. Setting up the matrix for the row reduction process, we 
get 


ro 1 1 2 14 
.| 101 S 23 


1 1 0 1 —1 0O_J 
which, on row reduction, finally leads to 


ri 00 7-4 #17 
010 a 
1001 2 § 2 


Hence, B= 0.) =| =e St. = ; 


L# ¢& 2J 
Again, to compute the matrix C = (7: G, G) = (yj), observe that 
T(—1, —2, 1) = (0, —4, —1), T(!, 3, —1) = (0, 6, 2), and 7(0, —1, 2) 
= (2, 0, —1). 
The equations to be solved here are 


—a-+ 86 = 0] 0 2 
The matrix of this system is 
r—l 1 0 00 27 
—2 3 —-!l —4 6 Oj}, 


L1-l 2 —1 2 -1 
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which, on row reduction, finally leads to 


Ti 0 0 aT ee 

[0 ie =<? = 

Lo 0 1 oy 
ee ee ee 
Hence, C=(yu)=| -2 7 -4 
L-* 1 4) 


It is now easy to verify that Bla.) == (a,,)C. 
(c) x= aut = 4(0, I, 1) + S(t, 9, 1) (I, I, 0) = (4, 3, 9) 


y= ak = 4(—], —2,1)+ s(1,3, -1) — (0, --1, 2) = (1, 8, —3). 


Now Ax = A(4, 3, 9) = A(4(0, 1, 1) + 5(1, 0, 1) — II, 1, 0)) 
= 4A(0, 1, 1) + 5A(1, 0, 1) — A(J, 1, 0) 
= 4—1, —1, 1) + 5(1, 3, —1) — (0, —], 2) 
= (I, 8, —3) =). 
(d) We have (SA)(0, 1, 1) = S(A(O, 1, 1)) 
= S(—I, —2, 1) = env, 
3 


= 1(—1, —2, 1) — 100, —1, 2) 
= (21, <b 1) 


and (AR)(O, 1, 1) = A(RO, 1, 1)) = A(2eu ui) 


= A(1(0, 1, 1) — 1(1, 1, 0)) 

= A(0, 1, 1) — A(I, 1, 0) 

= (—1, —2, 1) — (0, —1, 2) = (—1, —1, ~1). 
Similarly, we could check that SA and AR coincide on the other basis 
elements u, and uw, also. Hence, SA = AR. 


Problem Set 7.7 


1. Repeat Example 7.1 for the following data : 
V=V, 
F = {(1, —1), (1, )} 
G= {(2, —3), (3, 3)} . 
(a) += (I, 0) 
(b) Ts Vy —> Va, T(r. X) == (41 + Xa, %1 — %9) 
(c) The given coordinate vector is (— 1, —1!) 
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[~—-1 —27] 
(d) The given matrix is | |. 
i ee ee 
2. Repeat Example 7.1 for the following data : 


V=YV, 

F = {(1, 1, 0, 0), (1, 0, 1, 1), (0, 0, 1, 1), (1, 0, —1, 0)} 

G = standard basis. 
(a) x= (1,1, 1,1) 
(b) 7: Va > Va, (x4, Xa, X3, Xq) = (X1, + X_ + Xs + XX, 0, 0, 0) 
(c) The given coordinate vector is (!, —2, 3, 0) 
(d) The given matrix is 

[~ 1 0 0 177] 


—|] 1 1 0 
0 oO -!1 
L1 -—2 3 4_] 
ro 27 | | 
3. Prove that | | is s milar to | | via the nonsingular 
2 7_J LO 6_] 
matrix 
r2 17 
5 V5 
1 2 
LV5 V5] 
mya -2) -3 0 OF 
4. Prove that 2 1 2 \issimilarto | 0 3 0 | via the non- 
L.—2 2 1_] 100 —3_] 
~ 0 _ 2 177 
1/6 V3 
: | ae os 
singular matrix V2 V6 V3 
i! L 
Lv2 v6 v3 
- 7 —1 —107 [~6 0 07 


5. Prove that —| 1 10 | is similar | QO. —12 O 
|_ —10 10 —2_) {9 0 18.) 
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riot 1" 
/2 6 V3 
a th ‘noul : oe 1 1 
via the nonsingular matrix J2 6 73 
GS eee 
L V6 v3_] 


6. Prove that similar matrices have the same eigenvalues. 


7.2 INNER PRODUCT SPACES 


In § 2.3 we talked about the orthogonality of vectors in V2 and V3. In 
this article we shall generulise this concept to al] finite-dinm-ensicnal vector 
spaces and to certain more general spaces called inner product speces. 


7.2.1 Definition Let V be a (real or complex) vector sp ce. An inner 
product on V assigns to each ordered pair of vectors u, vin V a 
scalar (complex if V is a complex vector space and reul if V is a teal 
vector sp‘ce), written as u - v, satisfying the following properties : 
(IPl) w-@@+tw)=u-v+u-w for allu, v,wn V 
(IP2) (au) - v= a(u vy) for allu, vy € V and all 

scalars a 
(IP3) us VezV-u 
(iP4) u-upPOandu u=O ifu = 0. 

7.2.2 Definition A vector space V together with an inner product ts called 
an inner product space. 

A finite-dimensiénal real inner product space is called an Euclidean 
space and a finite-dimensional complex inner product space is called a 
unitary space. 

We shall now give some elementary consequences of Definitions 7 2.1 
and 7.2.2 in the form of a theorem. Note that we state the results for 
complex inner product spaces. The corresponding results for real inner 
product spaces are obtained by merely omitting the complex conjugations, 
7.2.3 Theorem Let V be an inner product space, u,v, and \\ be any three 

vectors in V, and «a scalar. Then 
(a) Utvy>-w=urwtye w. 
(b) uc(av), =alu- y). 

(Cc) O° wu =O=u- 0. 


Proof: (a) (uty -w=w-e(ut+vy=weutw- py 
=weutwevos=urewt+t+vew, 
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(b) u- (ay =(@)-u=aly- aw) 
= Oy + 4) = @(y -y). 
(c) O-4n = (Ov) -u=O0(v-u)=—0. 
The second part of (c) can be proved similarly. §j 
Example 7.2. In VS we can define an inner product as follows : 


If u = (2X, Xa, ..., Xn) and v = (y1, Vo, .- » Yn), then 


Us V = XP t+ XPe t+... + ADn- (1) 
For a real vector space V,, the analogous inner product is 
Us v= XY + Xe t+... + Xan - (2) 


Note that this has already been defined (cf Definition 5.4.2). 

It 1s routine to verify that Equations (1) and (2) are inner products on 

ye and V,, respectively. Clearly, the familiar dot product on V, and V, 

is a special case of the inner product thus defined on V,. Therefore, V, 

and V;, endowed with the usual dot product, are inner product spaces. 

This also explains why we use the notation u - v for the inner product in 

general inner product spaces. 

724 Remark If u and v are considered column vectors, then u - v can 
also be written as the matrix product u7y. On the other hand, if 
they are considered row vectors, then u + v = uy!. 

7.2.5 Remark The inner product defined in Example 7.2 is called the 
natural inner product on VS (V,). Problem 5, of Problem Set 7.2, 
gives another inner product on V,. 


Exam) le 7.3 Consider the vector space %7[0, 1]. Define 


1. 
fg=Sfded, 
where f, zg © ¥'[0, 1]. It can be verified that this is an inner product on 


the space. 
Analogously, on Ge {0, 1] we can define an inner product 


fig = J, Aogeode. 


Let V be an inner product space. Then for each vectoruG V,u- au 
is a nonnegative real number irrespective of whether V is a real or a com- 
plex vector space. We write 


PTTL TINS 


| wll = +/(u + w) (3) 
and call it the norm.afu. In Examples 7.2 and 7.3 we have 
H (X35 Xap oy Xn) = (fr | P+ Le] P+... + | xn | (4) 


and wst=(5, Roltay” (5) 
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Equation (4) suggests that the norm of an elément u may be considered 
the ‘distance of u from the zero of the space’ or the ‘length of the vector 
wu’. We shall, without further ado, call || «|| the length of u even in the 
general case. The properties satisfied by || u |] in an inner product space 


are given in the following theorem. 


7.2.6 Theorem Let V be an inner product space. Then for arbitrary 
vectors uand vin V and scalars «a, 
(N1) lawl =[oa] ful 
(N2) ull @Oand| ull =0ifu= 
(N3) [u-v[_ <i ivi 
(N4) lutvi<ciad +ivil. 

(N3) is called Schwarz’s inequality and (N4) is called the triangle 
inequality. The triangle inequality simply generalises the familiar 
geometrical fact that in a triangle any side is less than the sum of the 
other two sides. 

Proof: (N1) jaw ll* = (au) + (au) = (aa(u + u) 
= la}*iw?, 
which gives (N1). 
(N2) This is a restatement of (IP4). 
(N3) This is clearly true ifu = 0. Suppose u 4 0. Consider 
w=V— au, 


_ vou 
where « = Tel?’ Then 


O<iwi*=w-w= (v — an) - (v— on) 
=v-y—ve (au) — (au) - v + (an) + (an) 
=vev— (v-u)— alu + v) + (a%)(y - uy) 
=|]vil*—aiv-u)—a-v+lal*ial?. 

Substituting the value of «a, we get 
lvey 


o<uvys— et, tea rik 
_ |veul? 
= vy ?— le il ) 
which gives (N3). 
(N4) letvi*=w+yv)-@t yv) 


=uouturcvy+tveuUutwveyp 
=u-uvete_u-v+-u-v+tevey 
= {full*+2Re(u- vy + ivil® 
<iel*+2{u-vi+iva’ 
<ivt*+2iat toi tiv? (by (N3)) 
=(lull+iviiy, 

which gives (N4). §j 
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Now we are ready to take up the concept of orthogonality of vectors 
in a general inner product space. Note that these ideas have already 
been developed for V, and V, in § 2.3, where we used the dot product 
without mentioning that it is an inner product on the space concerned. 


7.2.7 Definition (a) If and »y are two vectors in an inner product space 
V, they are said to be orthogonal if u - v = 0. 
(b) A set of vectors is said to be orthogonal if each pair of distinct 
vectors of the set is orthogonal. 


728 Theorem Any orthogonal set of no zero vectors in an inner product 
space is LI. 


Proof: Let A be an orthogonal set and B = {t, ug, ...,U,} bea 
finite subset of A. Consider 
Oyty t Agly + -- + anu, = 0. 
Then, for every i = 1, 2, ..., 7, 
O=0-4, 

= (ayy + ogg +. + Only) © Uy 

= 0(%, - u,) + g(t ° Ug) + oe + On( Uy - &)° 

= a,(u, - %,), sinceu, > u, = 0 fori ¢ 7. 
Since u, # 0, we get «, = 0. Hence, every finite subset of A is Li and 
therefore Aisi. § 

The converse of Theorem 7.2.8 is not true. Jn other words, not every 
linearly independent set is orthogonal. This can be seen from simple 
examples, such as 

{2i, 2i + 37} 
in V,. But, given a linearly independent set, we can arrive at an ortho- 
gonal set in a standard way, which is very important. This construction 
is called the Gram-Schmidt orthogonalisation process. We build this in 
the proof of Theorem 7.2.10. But first we shall introduce the concept of 
vector projection, analogous to the situation in V, and Vs; (cf Theorem 
2.3.8). 


7.2.9 Definition If u and v belong to an inner product space V and 
vy ~ 0, then the vector 
ur, 
Hv? 
is called the vector projection of u along v. 


7.2.10 Theorem Every finite-dimensional inner product space has an 
orthogonal basis. 


Proof: Let {ty, tl, ++» Ua} be a basis of the inner product space 
V. We shall construct an orthogonal set {V1 Ys. ---» Yn} Of vectors in V, 
which is a basis for V. Write v, = u,. To construct v,, subtract from u, 
its vector projection along v,. So 
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v, = ty — By 
2 i 
vs Wl * 


This gives v, - vy, = 0 and so {¥,, vy} is an orthogonal set. 


Now to construct vs, subtract from u, its vector projections along », 
and y,. Thus, 
Uy ' Wy Ua * Ve 
ae ee ee 
This gives vs * ¥, = 0 = vs - vp. (Check.) Hence, {,, vg, v3} is an 
orthogonal set. Observe that we kave so far used only three of the 
vectors of the given basis. Proceeding thus and using all the vectors 
U1, Ue, ---» Un, We Construct the orthogonal set B = {v,, ve, ...» Vn}, Where 

i-l 


w) u: a! Vv; ° 
pe tg ee 


None of the vectors of B is zero, because if y, were zero, then u, would 
be a linear combination of v,, Vz, ..., ¥.-, and therefore of uj, te, .-., Ue-1- 
By Theorem 7.2.8, B is a linearly independent set and hence a basis for 
the.n-dimensional space V. 


Vg = Uy — 


y= uy; 


7.2.11 Definition An orthogonal set of nonzero vectors {ty, ug, -- , U,} is 
said to be orthonormal if || u, || =1, @ == 1, 2, ..., m. 
Clearly, {i,j,k} is an orthonormal set (in fact, basis) of V3. From 


Theorem 7.2.10, it follows that every finite-dimensional inner product 
space has an orthonormal basis. : 


7.2.12 Remark In the Gr. m-Schmidt construction, described in the proof 
of Theorem 7.2.10,-we started with x vectors, which formed a basis 
for V. Even if we had started with fewer than m elements, the 
construction would have worked, provided those elements were LI. 
The resulting set would have been merely an orthogonal set and 
not an orthogonal basis. 

In Example 7.4 we shall apply the Gram-Schmidt construction to 
produce an orthonormal set from a given linearly independent set (which 
is not a basis). 


Example 7.4 Orthonormalise the set of linearly independent vectors 
{(1, 0, l, 1), (-—l, 0, —I, 1), (0, —I, I, 1)} of Ve. 
Let vy, =(1,0,1, 1). Then 


v, = (—1, 0, —1, 1) — CLOT +, 0, 1, )) (1,0, 1, 1) 


— (—i, 0, —f, f) ° 
= (0, —1,1,1)— SEED GOED Gg 6,1,1) 
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Gob 1 26 3 234) 213, 0, -213, 48 

== (—1/2, —1, —1/2, 0). 
The resulting’ orthogonal! set is 

{(i, 0, 1, 1), (—2/3, 0, —2/3, 4/3), (—1/2, —1, —1/2, 0)}. 
The corresponding orthonormal set is 

(— 1//3, —- 2/3, — v3, 0)} e 

Example 7.5 Find an orthonormal basis of ¥;[—1, 1] starting from the 
basis {1, x, x®, x°}. Use the inner product defined by 


f-g= J), fideltdt. 


We take y= 1, 
Then max 2 tt 
- x — (bf), dt) = 2. 
x? . | x? -x 


dic ge a ce Ben Ee 
ree eat gee ae 
x asl, de — ax sl edt = x — 4. 


x*. | D iar x® + (x? — 1/3) 


Thus, the orthogonal basis 1s 

{l, x, x® — }, x? — $x}. 
To get the corresponding orthonormal basis, we divide these by the res- 
pective norms - get 


oe 3v/5 x2 SV7 3 


Problem Set 7.2 


1. Use the Gram-Schmidt process to orthonormalise the linearly inde- 
pendent sets of vectors given in Problem 1, Problem Set 3.5. 


2, Repeat Problem 1 for Problem 2, Problem Set 3.5. 
3. Repeat Problem 1 for Problem 3, Problem Set 3.5. 


(Take the inner product in the space to be j a K(t)g(t)dt.) 
4. inan janer product space V show that 
(a) Ifv-u=Oforallu € V, then v = 0 
(b) Ifv-u=w-uwforallu € V, then v = w. 
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5. 


Show that an inner product can be defined on V, by 
= = xi + x ») 
(x1, Xa) ° On) = Ga = 20 — Yd) 4 Gs uO + Yo) 


In this inner product space calculate 

(a) €, - & (b) (1, —1) > (1, 1). 
(This is a generalisation of Problem 5.) Let B be a basis of an 
n-dimensional vector space V. Define, for arbitrary x, y E V, 

x-y=[x]s- Dp, 

where the inner product of coordifate vectors on the right-hand side 
is the natural inner product of VS, Prove that this definition gives 
an inner product on V. In this inner product space prove that the 
basis B is orthonormal. 
Prove that all the eigenvalues of a symmetric matrix are real. 


Let the set {v,, vg, +--, vn} be LD. What happens when the Gram- 
Schmidt process of orthogonalisation is applied to it ? 


7.3 ORTHOGONAL AND UNITARY MATRICES 


We shall discuss two special types of matrices in this article, and 


assume the natural inner product on V, and VS. 
7.3.1 Definition (a) A real square matrix H is called an orthogonal 


matrix if 
ATH = 1 = HH’. 

In other words, H? = H-., 

(b) Acomplex square matrix U is called a unitary matrix if 
U*U = J] = UU*., 

In other words, U* = U-', 


For example, 


| 


[- cos® sin 07] V2 V2 
| is orthogonal and 


is unitary. 
{.—sin®@ cos 6_| 


LV2 V72_ 


Orthogonal and unitary matrices are important because they corres- 


pond to certain linear operators that have significant properties. But, 
since we shall not be discussing such operators in the general setting of a 
vector space, we shall be content with deriving certain fundamental 
properties of orthogonal and unitary matrices. 


7.3.2 Theorem A real (complex) square matrix is orthogonal (unitary) iff 


the rows of the matrix form an orthonormal set of vectors or iff the 
columns of the matrix form an orthonormal set of vectors. 
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Proof: We shall prove the theorem for the complex case. By 
removing all the complex conjugations in the proof, we get the proof for 
the real case. 


Let %, Ug, ..., 4%, be the column vectors of a complex square matrix 
U. Then 


[ ut 7 
ul 
U = [u, ug ... ua] and U* = : 
Lat 
where u, = (U1, Mas, Uni)? and u; —= Aes Yar, o%, Ung). 
(~ wt 4 
uy 
So U*U = ; (14, Uy --» Up] 


L 
ulu, alu, ... ulu, | 
mG aru, ulus oes Glu, 
Liu, fu, uTuy_ 
This is the identity matrix J iff 
utu; = 0 fori ~#J 

and ulu, = | for all i = 1, 2, ..., 7. 
This means that the set of column vectors {t,, ua, ..., %,} is orthonormal. 

To prove that this requirement is equivalent to saying that the rows 
are orthonormal, we have to note only that U*U = 7 implies UU* = TI 
(and vice versa), and this latter is true iff the columns of U* are ortho- 
normal. §j 
7.3.3 Theorem (a) The orthogonas n x n matrices form a group for 

multiplication. 
(b) The unitary n X n matrices form a group for multiplication. 

The proof is left to the reader. The groups mentioned in the theorem 
are called the orthogonal group of order n and the unitary group of order 
n, respectively. 

We shall end this article by giving a definition. 

7.3.4 Definition (a) Two square matrices A and B of the same order 
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are said to be orthogonally similar if A = HBH-' for some ortho- 


gonal matrix H. 
(b) Two square matrices A and B of the same order are said to be 
unitarily similar if A = UBU™ for some unitary matrix U. 


Problem Set 7.3 


If H is orthogonal, prove that det H = -L1. 
If U is unitary, prove that | det U | = 1. 
If U is unitary, show that U, y™, and U* (k a positive integer) are 
also unitary. 
If H is orthogonal, show that H’ and H* (k a positive integer) are 
also orthogonal. 
Show that 
FO 17 FO -iq] Fil 071 


| |, | | | | 
Ll 0jJ Le O.} LO —14 


are unitary, involutory, as well as Hermitian. 
Prove that if U is unitary and U*AU and U*BU are both diagonal 
matrices, then AB = BA. Is this result true if U is replaced by a 
real orthogonal matrix H ? 
Let T be the linear operator on V; defined by 7(x, y, z) = (x’, y’, 2’), 
where x’ = xcos¢ — ysing, y = xsingd + ycos ¢, z’ = z, with 
respect to a cartesian coordinate system. Prove that 7 is given by 
an ortiogonal matrix. 
True or false ? 

(a) Every real symmetric matrix is orthogonal. 

(b) Every Hermitian matrix is unitary. 

(c) If for a complex matrix A, AA* = A*A, then A is unitary. 

(d) The eigenvalues of a unitary matrix have absolute value 1. 

(ec) Ifa matrix is unitary, it is also Hermitian. 

(f) The columns of 


7 f —— ” = 


form an orthonormal set of vectors. 


7.4 APPLICATION TO REDUCTION OF QUADRICS 


In this article we shall use the concept of an orthogonal matrix to 


reduce a real symmetric matrix to the diagonal form by a similarity 
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transformation. An analogous reduction of Hermitian matrices to 
diagonal form by a similarity transformation using unitary matrices is 
possible; such a reduction and related topics are covered in advanced 
textbooks. Since the problem of reduction of a real symmetric matrix to 
diagonal form is the same as the geometrical problem of reduction of a 
quadric to its principal axes, we start this article with a discussion of the 
geometrical aspect. 
In 2-dimensional analytic geometry the equation of a central conic 
referred to its c.ntre as origin is of the form 
ax® +- 2hxy + by? =k. 
This can be written in matrix form as 
Ta hl Px] 
[x y] | i | jk. 
Lh 63 Ly 
In 3-dimensional analytic geometry a similar equation represents what 
is called a central quadric. It is of the form 


[ah gy [x] 
hb f y | =k. 


Le fel LzJ 
In detail, this equation is 
ax? + by® + cz? + 2fyz + 2gzx + Zhxy =k. 

In general, even in » dimensions, we can write a similar equation. 
The surface represented by it is called a quadric in n dimensions or simply 
aquadric. [ts equation is of the form 

u Au—k, 


[x y 2] 


where 


[x] 


Xa 


LJ 
and A is a real symmetric matrix of order 7. 


In discussing a quadric in V, we shall use geometrical ideas like 
tangent and normal. A tangent to a quadric is a line that meets the 
quadric at two or more coincident points. If a straight line is perpendi- 
cular to the set of all tangents at a point, we say it is a normal at the 
point. We assume the natural inner product on V, and begin with a 
fundamental lemma. 


7.4.1 Lemma If uy is a point on the quadric u’Au = k, then the normal 
at u, is in the direction of Aug. 
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Proof: Figure 7.1 represents 
the situation in the 2-dimensional 
case. Let L= {u,+itv|t€ R} 
be an arbitrary tangent, in the Uptt¥ 
direction of vy, at u, on the surface. 
L clearly passes through the point 
uy. Any other point, sav uy + ty, 
where this line L meets the quadric, 
will be given by those velues of ¢ 
that are roots of (uy + tv)TA 
(uy + tv) =k. This is a_ scalar 
equation, though written in matrix FIGURE 7.1 
form. It simplifies to 

ul Au, + tv’ Au, + ul A(tvy) + PrTAV =k. 
But ul Au, = k, since u, lies on the quadric. So the equation becomes 
tyTAuy + ul Av) + PrTAv = 0. 
One root of this is ¢ == 0, which corresponds to the point u, itself. In 
order that ZL may be a tangent to the surface, we require the other root 
also to be zero. This gives 
w'Au, + ul Av == 0. 
But wv’ Au, and ul Av represent the same real scalar. Hence, 
wWAu, = 0= ul Ay, 
The first equation means Au, is perpendicular to v, i.e. to uy + fy, an 
arbitrary tangent at u,. Thus, Aup is perpendicular to all tangents at up. 
In other words, Au, gives the direction of the normal atu. §j 
Let uy be a point on a quadric. Then the vector up is said to deter- 
mine the direction of a principal axis if it is normal to the quadric at the 
point vu). By Lemma 7.4.1, it follows that the principal axes are in the 
directions u,, where Au, = Au, for some real scalars A. Thus, we have 
established the following theorem. 


Uo 


Oo 


< 


7.4.2 Theorem In the quadiic uTAu = k the principal axes of the quadric 
are in the direction of the eigenvectors of A. 


Example 7.6 Find the directions of the principal axes of the conic 
10x? + 4xy + 7y* = 100. 
In matrix form this is written as 
[10 24 [xq 
[x y} | || |= 100. 
L2 7.) Ly 
10 27 
The eigenvalues of A = | | are given by 
L2 7) 
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10—Aa 2 
2 7—A 


=0, 


which gives A = 1], 6. 
Corresponding to the eigenvalue 4 = 11, the eigenvectors are given by 


T-l 20 7x7 oq 
| =| |. 
L.2 —4) LyJ LO 
[~27] 
This gives an eigenvector| |. 
Lj 


Again, corresponding to the eigenvalue 4 = 6, the eigenvectors are 
given by 
“4 27) Fx] fo7 


= |. 
L2 1JNtytJ Le 


~ 
This gives an eigenvector | |. Therefore, the axes of the conic are 
L.—2_] 
along the directions (2% + j) and (i — 2j). 
In Example 7.6 we have determined two eigenvectors corresponding to 
two distinct eigenvalues. Naturally they are orthogonal. Let us normal- 
ise these vectors and construct the matrix 


fr 2 17 
V5 V5 
= H (say). 
1 
LvV5 V5] 


Observe that this 1s an orthogonal matrix (since its columns are ortho- 
normal). Use this as a similarity transformation on the given symmetric 
matrix 


pe 2° 
7 |. 2 71) 
Calculate H’AH. We obtain the matrix 
11 O07 
D= | , 
| oO 6_J 


Note that this matrix is a diagonal matrix whose diagonal elements are the 
271 

eigenvalues of A. Thus, A = | | is orthogonally similar to the 
[2 7J 


Till 07 
diagonal matrix D = | |. The passage from A to D is called 
Lo 6_J 
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diagonalisation. The geometrical implication of this diagonalisation can 
be understood by going back to’ the equation 

10x? + 4xy + 7y* = 100. 
This equation contains tne xy term; sO we do not know the exact size and 
lecation of the conic except that itis an ellipse, since its discriminant 


h? — ab = --66 < 0. To find the length of the axes we transform the 
[~x7] x7 

coordinates | | to the new coordinates | | by the formulae of trans- 
Ly Ly’ 

formation 


x =x’ cos@ + y’ sin 6 
y= —x'sin®9 + y’ cos®@, 
where 6 is the angle of rotation of the axes. We know from analytic 
geometry that if © is suitably chosen, the xy term will vanish in the new 
coordinates, and the lengths of the axes can be found by inspection of the 
transformed equation. The theorem on the reduction of a real symmetric 
matrix, which we shall now prove, will produce this value of 8 without the 
help of geometry. This theorem of linear algebra says that the required 
~~ x' 
transformation matrix from | | to [ | is nothing but the orthogonal 
Lyd Ly 
matrix obtained from the normalised eigenvectors of A. In Example 7.6 
it is just 


fr 2 177 
5 
wa| vs Vv 
|} 1 2 
LW/5 /5—! 
Using this, we get 
[(— 2 ] 
ae /5 /5 pe 
Ly 2 dos. 
Lvs vs 


Write this as u= Hv. Then urdu = k becomes w'HTAHY =k. This 
simplifies to 


ll 07 Fx’ 4 
[x’ y']| | | | = 100, 
LO 6J Ly’ 
i.e. llx’? + 6y’? = 100 


2 ¢ 
—_ x + y : poe 1 s 
ClO/y/11)*® © (10/+/6)? 
This is an ellipse with lengths of semiaxes 10/4/11 and 10/./6. This 
analysis shows that 


or 
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(i) the eigenvectors of A give the directions of the principal axes of the 
conic; 

(ii) the eigenvalucs A, and A, of A specify the lengths of the semiaxes 
Vk and y‘k/As; 

(iii) the orthogonal matrix H constructed out cf the normalised eigen- 
vectors of A is the matrix that reduces A to the diagonal form; and 

(iv) the matrix A is orthogonally similar to a d agonal matrix, whose 
diagonal elements are the eigenvatues of A. 

We shall now prove that this situation is true in the n-dimensional 
case also, at least for the case where the matrix has distinct eigenvalues. 
The result of the theorem is true even for general real symmetric matrices. 
But we leave the theoretical development of this case to more advanced 
textbooks. 


7.4.3 Theorem (Diagonalisation of a real symmetric matrix) Let A be a 
real symmetric matrix with distinct cigenvalues. Let the normalised 
eigenvectors of A be written as column vectors of a matrix H. Then 
(a) H is orthogonal. 


(b) HTAH(--D) is a diagonal matrix, whose diagonal entries are 
the eigenvalues of A. 


(c) A is orthogonally similar to the diagonal matrix D. 


- Proof: (a) First, we prove that the eigenvectors of A corresponding 
to distinct eigenvalues are orthogonel. Let u, and wu, be e genvectors 
corresponding to distinct eigenvalucs 4, and ?,, respectively Note that 
both are real (see Problem 7, Problem Set 72). Then 
(Ar — Ae) - Uz) == Ay(Uy * Us) — Ag(ty - Me) 

= (Ayu, Ug) — (Uy + Agta) 

s= (Au, > u,) — (& - Aug) 

= (Au,)"U, — ul (Aug) 

= ulATu, — ul Au, 

= 0 (because A? = A). 
Since A, # A,, it follows that u, - vu, = 0. This coupled « ith Theorem 
7.3.2 shows that # is an orthogonal. matrix. 


(b) H=[u, ty +: Un) ; 
where u,; are the eigenvectors of A written as column vectors. 
[ut [ulA | 
uf ulA : 
So H'A = A= 
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(Aw) Ow) 


(Auz) | (Agua)? | (where the A,’s are the corres- 
= = | ponding eigenvalues) 
| 
| t 
L (Au,)" L(Qnun)7_I 
“A, O «.. OTF Fut q 


z | 0 A, eos 0 ul 
LO O.... ae Lut _| 
-- DH’ = DH», 


Y'ence, HTAH = D as required. 
(c) This is only a restatement of (b). 
Example 7.7 Reduce the quadric 
~- 7 —-) -10) (x9 


24 7 10 y |= 36 (1) 


{—-10 10 -2_) {2_J 


to its principal axes. Note that when this equation is written in full it 
takes the form 


7x -+ Ty® — 22? + 20yz — 20zx — 2xy = 36. 
According to the preceding discussion we need to reduce the matrix 
~ 7 —1 —1094 


A= ~—I 7 10 


[x y z] 


L.—10 10 --2_J 
to the diagonal form. The eigenvalues of A are 6, —12,and 18. The 
corresponding eigenvectors are (1, 1,0), (1, —1,2), ard (1, —1, —1). 
Hence, the normalised eigenvectors are 
(M//2, I//2, 0), (1/6, —1/+/6, 2/6), and (1/3, —1//3, —1/+/3). 


These three vectors give the following orthogonal matrix 


(1 1 ty 

V2 V6 ¥3 
ill, eet eed 
| ye ae af 
—- 


L v6 v3 
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Hence, H'AH 
[it l 1 | 17 
7 : 0 2 é. 
V2 2 2 V3 
. a —107, ol a 
hes ehdin, 2 ; # | 1 
=| Vo 6 | we EN ae gags 
~10 10 —24! 
je ee A se bol 
Lv3 v3 V3_] L V6 v3) 
r6é 0 07 
= 0-12 0 | 
LO 0 184 


is the required diagonal matrix. 
So the equation of the quadric referred to 1ts axes is 
6x? — 12y? + 1827 = 36, 
: x? y? 2 
1.€. oe — 3 37 = | 
This is a hyperboloid of one sheet. 

We shall conclude this article with another example where the matrix 
does not possess distinct eigenvalues. Though we have not developed the 
necessary theory for this, the following example will show that a reduction 
to diagonal form is possible even in such a case. 


Exampie 78 Reduce the matrix 


~ 12 -—27 
A=| 21. 2 
L~2 2 {J 


to the diagonal form, and hence reduce the quadric 
x? + yt 4- z* b 4yz -- 4zx + 4xy == 27 (2) 
to its principal axes. 


The eigenvalues of the matrix A are 3, 3, and — 3. Note that in this 
case 3 is a repeated eigenvalue. So Theorem 7.4.3, which depends on 
the fact that the matrix has distinct eigenvalues, cannot be applied. How- 
ever, an orthogonal matrix can be obtained by looking at the eigenvectors 
corresponding to 3 and —3. 

The eigenvectors corresponding to the eigenvalue 3 are given by 


r-2 2-27 Pxq 07 
» 2 2 | | ; * 0 r 
L—-2 2 —2.j) Lz} Lol 
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This gives only one equation : 
x—-ytz=03 


The solution set of this is the subspace {(y — z, y, z) | y, z & R} of V,. 
We can choose two linearly independent vectors in this 2-dimensional 
space by giving suitable values to y and z. Taking y = 1 and z = 1, we 
get (0,1, 1); and taking y = 1 and z = 2, we get (—1,1,2). Since 
these two are LI, we have only to orthogonalise them. Using the Gram- 
Schmidt process, we get two orthogonal vectars 
(0, 1, 1) and (—1, —1/2, 1/2). 

Normalising them, we get 

(0, 1/+/2, 1/2) and (— y2/-73, — 1/76, 1/76). 
The third eigenvector 1s the one that corresponds to the eigenvalue —3 
and is (1, —1, 1). 

Normalising this vector, we get (1/+/3, —1/4/3, 1/+/3). Without 
checking, we can say that this will be orthogonal to the two eigenvectors 
corresponding to 3, because eigenvectors corresponding to distinct eigen- 
values are orthogonal. Thus, we have the orthogonal matrix 


Fe wv? 07 
/3 


V3 | 

1 1 1 
wo) a ye V3 * 
re a ae 


Foy» tt 1 ~ >) v2 17 
2 V2 3 3 
yew’ |e 2 2 225 ue, 

aves el 21 2j}— -—4 -4 
V3 Vf/6 +/6 V2 v6 ¥3 
29 9 

ala —, 1_| toa 
Lv73 73 V3_] Lv2 v6 V3] 

r3 0 Of 

= 10 3 0 | 

10 0 —3_; 


Thus, the quadric (2) reduces to 

3x2 + 3y* — 3z* = 27, 
7 x Pas one a aE 
i. “> Tt 5 7 =i. 
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It may be noted here that Equation (2) can be written as 
~ 12 -29 x4 
| 
2 | 2 y | = 27. 
| —2 2 1J Lz] 


[x y 2z] 


Problem Set 7.4 


1. Reduce the following matrices to diagonal form : 
[~5 ] 17] [ 6 4 —27] (4 3 31 
1 5 —! to) 4 12 —4 © 3 0-1 | 
L1 —-1 a L--2 —-4 13_J {3-1 3_) 
2. Reduce the following conics to their principal axes : 
(a) 7x* + 52xy — 32y? = 180 
(b) 17x* + 312xy + 108y* = 900 
(c) 145x3 + 120xy + 180y* = 900. 


(a) 


Appendix 


Ordinary Linear 
Differential Equations 


In § 4.9 we saw that the general solition of the n-th order normal 
linear differential equation 


ax) O24 ax)” + oe + anlady = (2) (1) 


is of the form y = jo -+ Yp, where ye is the solution of the associated 
homogeneous equation 


d" dq") * 
a,(x) oe + a(x) wat + = +a,(x)y = 0, (2) 


and yp is one particular solution of (1). yo is called the complementary 
function and is the kernel of the linear differential operator 


da" d=! 
L = a,(x) axe + a,(x) | + ...4 a,(x). (3) 


Thus, the method of solving Equation (1) involves two steps, namely, 
finding ye and yp. Further, it may be noted that the solution space of 
Equation (2) is n-dimensional (cf Theorem 4.9.3). 

The solution of the first order normal linear differential equation has 
thus been completely discussed in § 4.9. In this appendix we shall develop 
methods of finding ye and vp for differential equations of arbitrary order. 


Al HOMOGENEOUS LINEAR DIFFERENTIAL 
EQUATIONS WITH CONSTANT COEFFICIENTS 


In this article we shall discuss the method of finding ye for linear 
differential equations with constant coefficients, i.e. the method of solving 
* The Zero on the right-hand side of Equation (2) should be 0. But throughout the 


appendix we shall use 0 as is the practice in writing a differential equation. The 
context will make it clear whether it is 0 or 0. 
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homogeneous linear differential equations with constant coefficients. To 
start with, let us consider the second order differential equation 

ay" +ay +ay=0, (4) 
where do, a, and a, are constants, and a, ~ 0. This equation may also be 
written as 

(a,D* + a,D + a,)y = 0 (5) 


where L = a,D* + a,D + a, is @ linear operator from 4'(I) to ¥’(J). 
It may be noted that Z is a linear operator also from Ce G7) to G(. 
In § 4.9 we saw that the equation 
dy 
Py + P(x)y = Q(x) 


has the complementary function y, = CelP(*)dx | When P(x) is a constant 
Pp, this reduces to ye = Ce”. Thus, the first order homogeneous linear 
differential equation 


or 


dy = 
a t v= : 


has the solytion Ce. Using this as an analogy, we try e™” (where m is a 
constant) as a solution of the second ordcr homogeneous linear differential 
equation 
(a,D* + a,D + a,)y = 0. 
This gives 
(agn* + aym + a,je™ = 

But e™ 1s never zero. So 

ayn? +am+a,=0. (7) 
Equation (7) 1s called the indicial equation or the auxiliary equation. The 
values of m for which Equation (7) holds will lead to solutions e™ of the 
differential equation (5). Let the roots of Equation (7) be m, and m,. 
Then e”™” and e”* are two solutions. Their Wronskian is 


4 é 


(my + m,)x 


wie, e™* ] = == (m, — m,)e 


me" me'™* 
The different roots of the auxiliary equation (7) give rise to the follow- 

ing three cases. 

Case 1 m,#m,_ In this case the Wronskian is never zero (cf Theorem 

4.9.2). So e”* and e”** are two linearly independent solutions of 

Equation (5). The solution space has dimension 2. Therefore, e”"* and 

e** form a basis for the solution space. Hence, the general solution is 


Yo= C, Piss al + C.e"™" . 
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Case 2 m, = m,. in this case it follows from Equation (7) that 

2m, = —a,/a, and one solution of Equation (5) is y, =e, 

mM, = —2,/2a,. Let ys be the other solution such that y, and y, are LI. Then 
eget 

Wie™ , ys] = Co te w= Ce 

oy Abel’s formula (cf Remark 6.9.4). a on simplification, gives 


ey’ _ mye” w= Cee 
Hence, y,— my, = Ce 
Solying this first order linear differential equation, we obtain a parti- 


cular solution y, = Cxe™™~ . This gives us y, = xe” as a second 


solution (taking C = 1) of Equation (5). Obviously, y, =e” and 
Ye = xe"™ are LI. (Why 7?) Hence, the general solution is 

ye = Cie™ + C,x e™™ 
Thus, we have obtained yc. 


Example A.1 Obtain y,, the complementary function for the differential 
equation 
(D* — 2D — l)y = sinx. 
The auxiliary equation of associated homogeneous equation is 
—2m—1=0. 
Its roots are m, = 1 + vi. m= 1 — V2. Soe t¥2)* ang ef! -¥2" 
are two linearly independent solutions of the associated homogeneous 
equation. Hence, 
Yo= Ce tv2 x + Cre (i-V2)x 
Example A.2 Consider the differential equation 
(4D* + 12D + 9)y = xe", 
The auxiliary equation of the associated homogeneous equation is 
4m? + 12m+9=0. 
Its roots are m, = ~3/2 = m,. As the roots are equal, the two linearly 
independent solutions are e~” and xe-**, ‘Thus, the complementary 


function is 

Yo = Cie“ + C,xe e 
Example A.3 Consider the differential equation 

(D* — 4D +. 13)y = x* + cos 2x. 
The auxiliary equation of the associated homogeneous equation is 
m' — 4m+13=0. 

Its ropts are m, = 2 + 3i,m, = 2 — 3i. Since m, ¥ msg, two linearly 
independent solutions are e'*+*" and e'*-*"_ Thus, the complementary 
function is 

Yo = Cyeite 1. Cigtt- me , 
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This is a complex solution. We shall now discuss the method 
real solutions from complex solutions. a 


Al.1 Lemma If u(x) + iv(x) is @ complex solution of a homogeneous 
linear differential equation Ly = 0 with real coefficients, then both 
(x) and v(x) separately satisfy the equation Ly = 0. 
Proof: Since u(x) + iv(x) is a solution of Ly = 0, we have 
L{u(x)-+- ir(x)) = 0. 
L is a linear operator. Therefore, 
L{u(x)) + iL{v(x)) = 0. 
Equating the real and imaginary parts, we get 
E{u(x)) = 0 and L(r(x)) = 0. 
Hence the lemma. §j 
Case 3 Auxiliary equation with complex roots If «+ iB is a root of the 
auxiliary equation (with real coefficients), then « — if is another root. 
Since m, + m,, two linearly independent solutions are ela tiOx ang 
e(*-P)* These are complex solutions. As 


elt tiP)x _ * cog Bx + ie” sin Bx 


is a solution of.the differential equation (5), it follows from Lemma Al.1 


that e cos Px and e~ sin Px are two real solutions of Equation (5). 
Further, they are linearly independent, because 


Wle™ cos Bx, e sin Bx] = Be 
is never zero. Hence, the complementary function can also be written as 
yo = C,e cos Bx + C,e~ sin Bx . 

If C, and C, are takea to be real, then we get all real solutions of 
Equation (5). For instance, in Example A.3 the real complementary 
function is 

Ye = €(C, cos 3x + C, sin 3x). 

We now state (without proof) the extension of the aforesaid method of 
finding ye for differential equations of arbitrary order. Consider the n-th 
order linear differential equation 

(a,D* + a,D*" + ... + GaiD + a,)y = 0, (8) 
where G4, 41, -*-, @n ate real constants. In this case also we try y = e™ 
as a solytion of Equation (8) and obtain the auxiliary equation 

aym® + ay) +... + aa + a, = 0. . (9) 

This has n roots (which may be complex). Some of the roots may be 
repeated. . 

For each real root « with multiplicity r (i.e. repeated r times) of the 


280 / APPENDIX 


auxiliary equation, the corresponding part of the complementary function is 
er"(Ay + Ax + oe + A,X") » 
where Ag, A;, ..., A,-1 are arbitrary constants. 
For each pair of complex roots « + i8 with multiplicity r, the corres- 
ponding part of the complementary function is 
e*(Ay + Ayx + ... + Ap x") cos Bx 
+ e@(B, + Bx +... + Bx") sin Bx. 
Let us illustrate these rules through a few examples. 
Example A.4 Find the complementary function of the diffefential 
equation 
y+ y = 2x* + 4sinx. 
The auxiliary equation is m®? + m = 0. Its roots are m = 0, i, —i. So 
the complementary function is 
Yo = Cy, + Cy cos x -+ Cy sinx. 
Example A.5 Consider the differential equation 
(D* — 10D® + 43D* — 100D* + 131D* — 90D + 25)y = x*. 
The auxiliary equation is 
m® — 10m ® + 43m* — 100m? + 131m? — 90m 4- 25 = 0 
or (m — 1)%(m? — 4m + 5% = 0. 
Its roots are m, = m, = 15m, =m =-2+im=—m=2—i1 
Corresponding to the repeated root ‘1’, the complementary function is 
e(Cy a Cx) 9 
and corresponding to the repeated complex roots, the complementary 
function is 
e*#f(C, + C,x) cos x + (C, + C,x) sin x}. 
Hence, the complementary function is 
Yo = (Cy + Cax) + 2%{(Cy + Cyx) cos x + (Cy + C,x) sin x}. 


Problem Set Al 
1. Solve the following homogeneous linear differential equations : 
(a) y’ + 4’ + 4y =0 (b) y’ + 4y=0 
(c) y’+y' =0 (d) 3y”+y’ —2y =0 
(e) yy" —y=0 (f) y” — 2y'—3y =0 
(gs) »’ + 2y’—-y=0 (h) yh" —y’—y'+y=0 


(i) (D‘+ 4D® -- 5D%\y =0 (j) (D?- D— 6D)y =0 
(kt) (D*+4D+ 1) =0 ()) (B— )Ity=0 

(m) (D* — 3D + 2)*y = 0 (n) (D'+ 3D+1)y=0 
(0) (2D? + 5D*'-- 3D)y=0 (p) (D? — 4D* + 4D)y = 0. 
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A2 METHOD OF VARIATION OF PARAMETERS 


In this and the next two articles we shall give various methods of 
finding yp for a nonhomogeneous ordinary linear differential equation. 
One method universally applicable to all linear equations (even to some 
nonlinear equations) is the method of variation of parameters. 

We shall illustrate the method by taking a second order equation 

(a,D* + a,D + a,)y = 2(x), a, # O. (1) 
Let the complementary function ye be 
Yo = Cyy,(x) + Cyy,(x), 
where C, and C, are arbitrary constants, ard y,(x) and y,(x) are two 
linearly independent solutions of the associated homegeneous equation of 
Equation (1). In this method we assume the particular solution yp to be 
of the form 
Yp(x) = uy(x)y,(x) + uy(x)y2(x) , (2) 
where u,(x) and u,(x), yet to be chosen, are twice differential functions of 
x. Our assumption will be justified if we can show that u,(x) and u,(x) 
can be chosen such that (2) is a solution of Equation (1). Since we have 
to determine two functions u,(x) and u,(x), we will have to specify two 
conditions. Obviously, one of these is that yp satisfies Equation (1). 
The other is to be chosen so as to facilitate the calculations. Differenti- 
ating Equation (2) with respect to x, we get 
yo(x) = wy(x)yy(x) + weg(x)y,(x) + 1y(x)yi(x) + a(x)y,(x) - 
In order to simplify the calculations, we shall impose the condition 
uy(x)y1(x) + u,(x)ya(x) = 0. (3) 
This implies 
Vp(X) = uy(x)y4(x) + a(x) y4(X) - 
So yp(x) = uy(x)yi(x) + ug(x)y"(x) + uy) + )(X) . 
Substituting yp(x), y"(x), and yp(x) in Equation (1), we get 
g(r, + Uae + Uy, + Mg¥g) + Gr(H, + MeV) + Ga(ry1 + eye) 
=: g(x). (4) 
Since y, and y, are solutions of the associated homogeneous equation of 
(1), we get 
Oey1 + ay, + Gayi = O and apy, + ayy + Oy, = 0. 
So Equation (4) becomes 
y(Usy; + Uys) = g(x) 
or 
UY, + Uays = B(x)/ap - (5) 
Equations (3) and (5) give two conditions governing t! ¢ choice of u, and 
u,. If we can choose u, and u, so as to satisfy these two conditions, then 
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we are through. Writing these together, we have 
t6y(x)yi(x) + 4,(x)y—(x) = 0 
us(x)y,(x) + (x) y4(x) = g()/a, . 

Solving for u,(x) and u,(x) by Cramer's rule, we have 


Ya(x)g(x) (6) 


u,(x) = agWLyi(X), Ya(x)) 
and 
y(x) 0 | 
v(x) glad _ ___Ya()a(x) (7) 


ma() ~ YX) Val. agW(y(x), Va(x)] 


yx) ya(x) 
Carrying out the integrations, we get 


= — pS yltdt 
u(x ) — ay Ww bilt), yall )} 
u(x) = f* g(t)y,(t)dt 


aWiy(t), yt] 
Thus, a particular solution of Equation (1) is 
stiyade yc px __stOn( ae 


ae x BUY Nhat Se 
ylx) = —nOV SO), ral] ayW[y,(t), yalt)) 
= pr Ylxyi(f) ~ yilx)y(t) a(t)dt . (8) 


aWiyilt), veld] 


Hence, the complete solution of Equation (1) is 


M1 = C(x) + Cry,(x) + i ee NTITG nae g(t)dt . 


A2.1 Remark The same: method is applicable to equations of arbitrary 
order. The only modification is that in the case of the n-th order 
equation we shall need » arbitrary functions 1,(x), u(x), -.-, #,(x) in 
yp» Since there are # arbitrary constants C,, C,, ..., C,, in the comple- 
mentary function. We shall impose on it (n — 1) conditions, one at 
each successive differentiation, in addition to the first condition that 
Yp = Uy, + Use + +--+ + Unyn Satisfies the nonhomogeneous differ- 
ential equation. 

Instead of carryiny out these details in the general case, we shall 
illustrate the method by working out some suitable examples. 


Example A.6 (D* — 2D — 1)y = sin x. 
The complementary function is (cf Example A.1) 
Celt Be yo fl-v 2x | 


Jo™= 
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So we assume 
yp = u,(xjeltv2)* + u,(x)et V2, 
We can now obtain u,(x) and u,(x) by going through the process already 


described. Since we have done this for the general equation of the second 
order, we shall merely plug in the functions in Equation (8). We have 


Wx), aX) = Wher V2, VI are 
Hence 
eli v2x I+V2)0 Iv 2)0 (I+-v2)x 


y (x) = escgouneerenerers i 
P J >. Dew sin t dt 
x (1+72 x o— + — _ 
= 9., j le ) é (V2+Ne el! v2)x efv2 ty sin t dt 


Ms 
= — 4 (sin x — cos x). 


A2.2 Remark The reader is advised not to use result (8) for finding yp. 
He should carry out all the steps needed to arrive at Equation (8) as 
illustrated again in Example A.7. 


Example A7 af + . = 2x? + 451n x. 
The complementary function is (cf Example A 4) 
Ye = C, + C,cosx + C,sinx. 
So we assume 
yp(x) = u(x) + u(x) cos x + u,(x) sin x. 
Then 
y(x) = u(x) + u(x) cos x + u,(x) sin x — u,(x) sin x + u,(x) cos x. 
When we impose the condition 
u(x) + u(x) cos x + u,(x) sinx = 0, (9) 
we get 
yp(x) = —u,(x) sin x + u,(x) cos x . 
Differentiating again, we get 
yp(x) = —my(x) cos x —u,(x) sin x — u,(x) sin x + u,(x) cos x. 
We now impose another condition 
—u,(x) sin x + u(x) cosx = 0. (10) 
So Yp(x) = —14,(x) cos x — u,(x) sin x 
and y); (x) = —u,(x) cosx — (x) sin x + u,(x) sin x — u,(x) cos x. 
The third condition on 1,(x), (x), ¥a(x) is that yp should satisfy the 
equation 
y' +y 2x? + 4sinx. 
Substituting yp, we obtain 
—ug(x) cos x — u(x) sin x = 2x* + 4sinx. (11) 
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Writing Equations (9), (10), and (11) together, we get 
u;(x) + u,(x) cos x + u;(x) sin x = 0 
— u(x) sinx + u,(x) cos x = 0 
— u,(x) cos x — u(x) sin x == 2x7 ++ 4sinx. 
Solving by Cramer's rule, we obtain 


u(x) = 2x? + 4smx, u(x) = —(2x* + 4 sin x) cos x 
and u(x)  --(2x* + 4s1n x) sin x. 
This, on integration, gives 
2x? 
u(x) = 3 7 4 cos x (12) 
u(x) -- —2 sin? x — 2x* sinx -- 4x cosx + 4sin x (13) 


and 
u,(x) = 2x? cosx — 4xsnx —4cosx ~ 2x + sin2x. (14) 


3 
Thus = yp(x) — 7 — 4cos x + u,(x) cos x + u,(x) sin x 


2x3 : 
-= 3 7 4cos x — 4x -- 2x sinx. 


Hence, the complete solution 1s 


3 
y= C, + C, cos x + C, sin x 4 7 — 4x — 4 cos x -~ 2x sin x 


= C, + Dycos x + Cy sin x + x? — dy — 2x sin x. 


Note that in this exumple we needed three conditions, because the 
differential equation involved is of order 3. 


Problem Set A2 


1. Using the method of variation of parameters, find the general solution 
for the following differential equations : 


(a) (D* + 4)y = x sin 2x (b) (D? — 4D + 4)y = xe-™ 

(c) (D? + 4)y = sec 2x, (d) 3D? + D —2)y = 32 
O<x< 2/4 

(ec) (4D? + ly = sec? x/2, (f) (D? + ly = sinx 
O<x<r 

(gs) (D7 +4D+ 4y = xe =(h) (6D + D — 2)y = xe* 

(i) (D* + D)y = x? (j) (D* — D)jy = x cosx 


(kK) yy" —3y" —y' + y= @M I" Fy" —y' = ert 


2. Let ya(x), Ve(X), -o+5 Yn(x) be mw linearly independent solutions of the 
associated homogeneous equation of 


(a,D* + aD! + ... + ayy = g(x). 


A3 METHOD OF UNDETERMINED COEFFICIENTS | 285 


Use the method of variation of parameters to prove that 
t 
yp(x) = J* K(x, p50 dt, where 


yi(t) ya(t) woe Y(t) 
y,(t) y4(t) ve Vat) 
Ke, ) = WE), nl PAD | 
yaiP2(t) alt) ee yl (0) 


yi(x) y2(x) see Pal) 


A3 METHOD OF UNDETERMINED COEFFICIENTS 


The method of undetermined coefficients is applicable whenever the 
right-hand member g(x) of the nonhomogencous n-th order linear differ- 
ential equation with constant coefficients 

(a,D® + a,D"1 4- ... + andy = g(x) (1) 
is a finite linear conibination of 

(i) powers of x; 

(ii) sin xx, cos x; 

(iii) e%*; and 

(iv) finite products of any of the functions in (i), (ii), and (iii). 

In order to outline this method, we need the following definition. 

A3.1 Definition Given a function /(x), a set of those linearly independent 
functions whose finite linear combjnations give the function f and all 
‘ts derivatives is called a derivative family of f(x). It is denoted by 
D{f]. 

Example A.8 Here we list the derivative families of four functions : 

(a) D[x™] = {x", x", .., xX, 5} 

(b) Dfe**] = {e**} 

(c) D{sin «x] = {sin ax, cos ax} 

(d) D[cos Bx] = {cos 6x, sin Br}. 

We shall be interested in only those functions f for which D[f] is a 


finite set; for example, the functions listed in Example A.8 and their 
finite products, namely, x”, e™, sin ax, COS ax, x™ sin ax, xX™ COS ax, 


xMet® o%@ sin Bx, e*” cos Px, x™e™* sin Bx, and x™e%* cos Bx. 
For each of these functions, a derivative family can be obtained as 
illustrated in Example A.9. 
Example A.9 D{e** cos 8x] = { f(x)a(x) | f(x) € Die), a(x) € D [cos Bx} 
= {e™* cos Bx, e~* sin Bx} . 
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D{x™ sin ax] = {f(x)g(x) | f(x) € D[x"], a(x) € D{sin ax]} 
== {x™ sin ax, x™-! sin ax, --., x Sin ax, sin ax, 
x™ cos ax, X™-! cos ax, .-., X COS aX, COS ax}. 

D[x*e™ sin Bx] = {f(x)g(x)h(x) | f(x) € Dlx], 
g(x) € Die**), h(x) E D{sin Bx)} . 
A3.2 Remark It can be easily verified that for two functions p(x) and 
q(x) 
D{ p(x) + q(x)] = D{[p(x)] U Diq(x)] . 

Now we are ready to enunciate the method of undetermined coeffi- 

cients for finding the particular integral yp of 

(a,D* + a,D*" + ... + a,)y = g(x) . 
Step 1 Write 

B(x) = g(x) + B(x) + ... + Sa(X), 
where each g,(x) is a function of the type mentioned immediately after 
Example A.8. 
Step 2. Find the derivative family D[g,) for each i = 1, 2, ..., k. 
Step 3 Find the complementary function ye of the differential equation 
in question. Let 

Yo = Cyy,(x) + Cayg(x) +... + Cayn(X) . 

For each i = 1, ..., k, check whether any member of D[g,] is already 
one of the y,’s, i.e. a solution of the associated homogeneous equation. 
If so, then multiply each member of D[g,], for that i, by the least power of 
x such that the new set thus obtained does not contain any y;. Call this 
new set the modified D{g,]. 

If no member of D[g,] is a y;, then leave that D[g,] unchanged. 

Step 4 Let S[g] be the union of all those D[g,]’s that have not been 
modified and all the modified D[g,]’s. 
Step 5 Assume 
Yop = 2 AA(x), 
where the A,’s are arbitrary constants, and A,(x) varies through all the 


members of S[g]. In other words, yp is a linear combination of all mem- 
bers of S[g]. 


Step 6 Substitute yp in the differential equation and determine the coeffi- 
cients A,’s by equating coefficients of identical terms on both sides. 
We illustrate this method through the following examples. 
Example A.10 (D* — 2D — 1)y = sin x. 
The complementary function is (cf Example A.1) 
yo Celtv2e 4 Co l-Vv ae 
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To get yp, we proceed as follows : 
Step 1 It is not necessary here. 


Step 2 D{sin x] = {sin x, cos x}. 


Step 3 No modification of D[sin x] is needed, because neither sin x nor 
cos x occurs in the complementary function. 
Step 4 S[sin x] = {sin x, cos x}. 
Step 5 Assume yp(x) = A sin x + Bcos x. 
Step6 yi(x) = Acosx — Bsin x, 
Yy(x) = —A sin x — Bos x. 
Substitution in the equation gives 
(2B — 2A) sin x — (2A + 2B) cos x = sinx. 
Therefore, 24 + 2B =0 and 2B— 24 =1. This gives A= —B 
we — 1/4. Hence, yp(x) = (cos x — sin x)/4. Thus, the complete solution 
is 
y= Cie t¥2)% “+ c,e1- V2) — (sin x — cos x)/4. 
Example A.11 (4D* + 12D + 9)y = xe-*?. The complementary func- 
tion is (cf Example A.2) 
Yo = Cie*/9 + Cyxe-™*, 
Step 1 It is not necessary here. 
Step 2. D{xe-*!*] = {xe-/*, e~*/*}. 
Step 3 Both the functions in the set D{[xe-**!*] appear in the comple- 
mentary function. So we multiply them by x*. (Note that multiplication 
by x will leave one function in the set to coincide with one in the comple- 
mentary function.) So the modified derivative family is {x*e-**/*, x*e*#/*}, 
Step 4 S[xe*i*] = {x*e-*P, x%e-*'3}. 
Step 5 Assume yp = Ax*e—**!* + Bxte*#", 


Step 6 yim een (Sf 4+ 34x8 — 38 x3 + 2Bx) 
bd 
y, wm ete 9A ys 94 yy 98 3s ape — 0 ot 


+ 6Ax — 3Bx + 2B). 

Substitution in the equation gives 

e-*2(24Ax + 8B) = xe! 
Hence, B= 0 and A = 1/24. Thus, yp(x) = (x*/24e-*"* and the 
complete solution is 

y = (Cy + Cx + x*124)e-*" . 
Example 4.12 (D* — 4D + 13)y = x* + cos 2x. The complementary 
function (real) is (cf Example A.3) 
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Yo = €*(C, cos 3x + C, sin 3x). 
Step 1 g(x) = x* + cos 2x = 8,(x) + 82(X), 
where g,(x) = x", 2,(x) = cos 2x. 
Step 2 D{g,] = {x?, x, t}, D[g,] = {cos 2x, sin 2x}. 
Step 3 No modification of the derivative families is needed. 
Step 4 S[g] = {x*, x, 1, sin 2x, cos 2x}. 
Step 5 Assume y)(x) = Ax? + Bx + C + Dsin 2x + E cos 2x. 
Step 6 Substitution of yp in the equation gives (2A -- 4B + 13C) 
+ (—8A + 13B)x + 13Ax* + (13E — 8D — 4E) cos 2x + (13D + 8E 
— 4D) sin 2x = x* + cos 2x. 
This gives A = 1/13, B = 8/169, C = 6/2197, D = —8/145, E = 9/145. 
Hence, 
Y= it et prt sae 
and the complete solution is 
y = e*(C, cos 3x + C, sin 3x) + yp. 
Example A.1l3 (D® + D)y = x* 4 2e* sin x. 
The complementary function is 
ye = Co + Ci cosx + Cy, sin x (cf. Example A.4). 
Step 1 g(x) = g;(x) + g.(x), where g,(x) = x?, g,(x) = 2e* sin x. 
Step 2 D{g,] = {x*, x, 1}, D[g.] = {e* sin x, e” cos x}. 
Step 3 Since ‘1’ is included in the complementary function, D[x?*] is 
modified as {x°, x", x}. 
Step 4 Sig] = {x*, x’, x, & sin x, e” cos x}. 
Step 5 Assume yp = Ax*® + Bx? + Cx + De® sin x 4 Ee* cos x. 
Step 6 Substituting yp in the equation, we get 
6A + 3Ax* + 2Bx + C — (D + 3E)e* sin x + (3D — E)e* cos x 


= x'+ 2e*smr. 
Thus, A = 1/3, B=0,C = —2,D= -1/5, FE = —3/S. 
Hence, 
Jp = ca re Sains es ce ree 
3 5 5 
and the general solution is 
y= Q+ Cy cos x + Cysinx + < — 2x Cn _ deh coer, 
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1. Using the method of undetermined coefficients, find the general 
solution for the following differential equations : 
(a) y”® — 2y’ — 3y = &* (b) y” + 4y = sin 2x 
(c) y" + 2y’ + 2y = xe” + x? (d) (D* + 2D — Ny = 2coshx 
(ec) (D®— D?'— D+ 1)y = sinx + 1+ xe? 
(f) (D* + 9D)y = x 
(g) (D' + D°? —D — 1)y = x sinh x + x? + 3 
(h) (D® + D)y = 2cosx 
(i) (Dt + 4D -- 5D’)y = x + xsin x 
(jj) y'—y’ — 6y’ = xe-* + sinx+x4+e™ 
(k) (D? + 4D + 11l)y = xe-* + e-* sin 3x. 


A4 OPERATIONAL METHODS 


The two methods discussed in § A2 and A3, namely, the method of 
variation of parameters and the method of undetermined coefficients, 
suffice to take care of all problems of finding a particular solution. How- 
ever, in this article we add to the reader’s armour another tool, which 
often comes in very useful: Consider the equation 

S(D)y = a(x), (1) 
where f(D) = aoD® + a,D"! + ... + da_~D + dn, and do, a, ..., Qn are 
constants. To obtain one particular solution of this equation, we are 
tempted to write formally 


l 
J = KH D) a(x) - (2) 


This is only a formal step, which would be useful only if it enables us to 
calculate y. First, we have to give a meaning to Equation (2). Second, 
we have to relate Equation (2) to Equation (1). We achieve both purposes 
simultaneously by defining Equation (2) as follows. 


A4.1 Definition If f(D) = aD" + a,D*" + ... + an, where do, G, ...5 Qn 
are constants, then 
1 
is defined as a function y for which f(D)y = g(x). 


This definition gives meaning to Equation (2) and also relates it to 
Equation (1). . 


We shgll now show that fB) g(x) can indeed be calculated easily in 


certain favourable situations. 


290 / APPENDIX 


The simplest case occurs vhen f(D) = D. Now + g(x) is that func- 


tion y for which Dy = g(x). This means 


2 = g(x). 


So y = J g(x)dx. Since we are interested in only one particular solutidn, 
we shall ignore the arbitrary constant. Thus, we have 
1 
—p 8%) = J a(x)dx. (3) 
Extending this we see that 


Br re) = SS e(a)dxax , (4) 
and so on 


We now take the case f(D) = D— a. Then a: g(x) is evaluated 
as follows: Let 
] 
y= D = 8) " 


Then (D — «)y = g(x), which is a linear differential equation. So 
y = e® Jf e-%*9(x)dx (cf § 49). 
Thus, we have 


I z  o-as 
ess g(x) = e** f e-**g(x)dx . (5) 
Example A.14 Calculate — e~* sin Bx. Using Equation (5), we get 


j : 
Dima © Sit Bx = e% J e-a%e™ sin Bx dx 


e** cos Bx 


gre 
To handle more complicated expressions for f(D), we first note the 
following result. 


A42 Theorem The set of all operator polynomials f(D) = a,D" + a,D*-" 
+.. + al, where ag, a,, ...,A, are in general complex constants, is 


a vector Space (real or complex, according to the scalars used) Here 
I is the identity operator. 


The proof is left to the reader. Note that each such f(D) is itselfa 
linear operator on ¢% (#), 


If f(D) and g(D) are operator polynomials, then f(D) o g(D) or 
simply f(D)g(D) is defined, just as we defined So 7 in Chapter 1, i.e, 
(f(D)g(D))y = f(DXg(Djy). This multiplication is 
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(a) associative, i.e 
SI(D)((g(D)h(D)) = (ftD)g(D))A(D) , 
(b) distributive over addition, i.e. 
S(D)(g(D) + h(D)) = f(D)g(D) + f(D)A(D) 
and (f(D) + g(D))h(D) = f(D)A(D) + g(D)A(D) , 
(c) commutative, 1.¢. 
S(D)g(D) = g(D)f(D) . 
A4.3 Remark It may be noted that the multiplication of operator poly- 
nomials is not commutative if the coefficients are functions of x. 
For example, 
(xD + I)D = xD* + D but D(xD + 1) = xD* + 2D. 
Because of the aforesaid properties, we may use the results of ordinary 
algebra pertaining to factorisation of polynomials. Note that D — I can 
be written as D — 1 without any damage to the working. In general, 
(D) = a,D® + a,D""* + ... + dal 
can be written as 
f(D) = a,D" + a,D"-! + dex -+- Ga > 
as we have been doing all along. In particular, we can factorise 
D* — 5D + 6as(D - 2)(D — 3). 


With this background, let us now handle 7H g(x). We illustrate 
the method through the following example. 


Example A.15 Evaluate Pp j sin x. 


We write 
l 1 1 
ae sinx =F) i OT 7 sin x) 
=p Je* sin x dx) (by (5)) 
=5 — (sin x — cos x) 
= 5 @ fe (sinx — cos x)dx (by (5)) 
1. 

a ee 


To solve such problems we can ea use per fractions es follows : 


ory tin = o= WOO 1\D + j 


3527- pep in* 
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_ I sin x — sin x 

~ 2 D—1 2 D+1 

=> e” f e* sin x dx — Se" J esin x dx. 
This, on simplification, gives 

1 : | 


Actually, there should be two arbitrary constants, but we omit them since 
we afe interested in only a particular integral. 


In such operator methads the following theorem is useful. 
A4.4 Theorem If f(D) is the operator polynomial a,D" +- a,D™"' + ... + dy 
with constant coefficients, then 
(a) f(D)e = flaje”. 
(b) f(D)(e*g(x)) = ex"f(D + a)g(x). 
(c) f(D’) sin ax =: f(—2?) sin ax. 
(d) f(D*) cos ax = f(—«?) cos ax. 
The proof of this theorem is left to the reader. Using Theorem A4.4 
and Definition A4.1, the next theorem immediately follows. 
A4.5 Theorem Let f(D) = aD" + a,D"-"' + ...+ a, be an operator 
polynomial with constant coefficients. Then 


1 ew” 
(a) fD) ew = f(z)’ f(a) # 0. 


l ve _ | 
(b) FD) ° e(x) == e” fd +2) g(x). 


(c) ie sin ax = Fo sin ax, f(—a*) ~ 0. 
(d) 7D cos ax = ory cos ax, f(—«’) + 0. 


1 ] l 
(e) FD) (P(x) + Q(x)) = JD) P(x) + JD) Q(x). 


| 1,1 
© jginy ? = ROG DPO”- 

With this theorem, let us find particular integrals yp for the differential 
equations in the following example, some of which we have already 
worked out by earlier methods. 

Example A.16 Consider the differential equations 
(a) (D* — 2D — 1l)y = sin x 

(b) (4D* + 12D + 9)y = xe-** 

(c) (D? — 4D + 13)y = x* + cos 2x 


P(x) 
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(a) Y= Hr 4 — sin x 


D? + 2D jas 1 
™ (D an ey — 1) — - 4pD* sin x 


= (D* + 2D —1) Cpr jr 4p sin x) 


1 . 
i (D? + 2D — 1) sinx (by Theorem A4.5) 
1 
oO 


(cos x — sin x). 


It may be noted that, as a working rule, we can use also the following 
method : 


] 
2D 2 Dah 


= a sin * (by writing —1 for D*) 
1 l ; 
se Dat 
—} ee ee —4(D — }) 
= D1 sin xX = ( Ga 7 sin x) 


1(D — 1) sin x (by ieee A4.5) 
—(sin x — cos x). 
Note that : this ne we replaced D* by —1. In general, to 


evaluate + sin ax or cos ax, we replace D* by —a* iu f(D) pro 


f(D ib) iD 
vided (D? + a*) is not a factor of f(D). 


~ Y= apy iD +9™ ~~ @D+3y** 
I 
--8@ /3 a 
=e 4p * (by Theorem A4.5) 
x%e-22 12 


24° 


(c) y= pop (x* + cos 2x) 


1 | 
= pray is* + aD F138 
Taking the second part, we have 


1 1 
Di — 4D 113 8 = 9-7 = |p 008 2x 
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9+ 4D 
= Sap cos 2x 


= (9 + 4D\5 a [6p: 098 2%) 


_ (9 + 4D) _ 9 cos 2x — 8 sin 2x 
= gg Oe ee 145 
To tackle the first part, we have no operational method so far. But 
the following ‘formal’ method, for which we cannot give any justification 
within the scope of this appendix, is successful : 
1 l 


Se, 8 = ee 
D*— 4D+ 13 1Ini+ 7 5? 
_ 1 ,,_ D'—4D , (D* — 4D) 
(by a formal long division) 
1 ,, 2-8 32 
= yy Oia + Tee? 
1 8x 6 
= ay +47 + Te 
Hence, 
x? 8x 6 9 cos 2x — 8 sin 2x 
y= 73 + joo tat Ts 


A4.6 Remark The working of pr DT i3 x’, though not justifiable 


at this stage, can be very powerful. The reader is urged to use it 
with the full knowledge that he is using only a formal method, the 
validity of which is beyond the scope of this appendix. 


In any case the reader will have already noted that wherever the 
operational method can be used it is really powerful. 


(d) y= sa sin x -+ 2x?) 
_ 4 1 
=prTTD (4sin x) + Dap (*) 
=p, + Yp 
iy ee ae ey eee (| sin x) 
Here Yp, = “DD + 1) =" (OF 1) ‘D 
= 45; 7 j¢—cos x) 


j 
= —Anr iT 00s x. 
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We cannot apply Theorem A4.5. In this case we continue as follows : 
ry ARES e*) 


= OM eer es 
4 Rel OTT D 
, 
= —4 Re (ef (D + 2i)D 1) 
= —4 Re (#5 > 5) 
= 4 Re ($1 +P — x) 


Tait 


= — 4Re (e(—--F | 4 )) 


x sin x 


= A(T cos x + 2 ) = -2xsmx—cosx. 
= ee ae ea es 
rar D i — (I D* 4 D‘ -- .. )x? 
2 2x3 
“gz GP — 6x) = => - 4x. 
Thus, 
Yp = —cos x — 2x sin x + 2x? — 4x, 


3 


It may be noted that the term (—cos x) can be omitted in view of the 
fact that cos x is a part of yc. 


Problem Set A4 


1. Factorise the operator in each of the following cases and hence find 
a particular integral : 


(a2) (Ph — lye 

(b+) (DP? —3D+ 2y=x-+ e* 

(c) (DB? + 4D* — SD)y = x + sin x 

(d) (8D* + 12D? — 2D — 3)y = x + xe”. 

2. Using operational methods, determine a particular integral for the 

following differential equations : 

(a) (D> — 3D°+7D + 5)y =e" 

(b) (D* + 9D)y = cos 3x 

(c) (D' + 3D + ly = & sin 2x 
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(d) (D? + 4D)y = sin 2x 
(e) (D* + 3D — 4)y = e7(3x* + 5x — 7) 
(f) (D — 2)*y = e* cos x 
(g) (2D* + 5D? ~ 3D)y = e-* 
(h) (D? — 4D + 4)*y = x2e”, 
3. Prove Theorem A4.2, 
4. Prove Theorem A4.4. 
5. Prove Theorem A4.5. 
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Answers to Problems 


Problem Set 7.17 


4. (a2) fxER|[-l<x<1} () {xE RR] —-1 <x <0} 
(c) {x E R] —1 <x < 3} (d) {xE R| Bx 20rx < —2} 
() {xE R[x plorx<—}} (f) ¢. 
5S. (a) The set of all complex numbers represented by the points inside 
a circle of radius 4 centred at the origin 
(b) The set of all complex numbers represented by the points on a 
circle of radius 4/3 centred at (- 5/3, 0) 
(c) {z2€ Climz < 0} 
(d) The set of all complex numbers represented by the points on a 
circle of radius 3 centred at (—2, 0). 
6. (a) d, {0}, {1}, {2}, {0, 1}, {0, 2}; {l, 2}; {0, I, 2} 
(b) 9, {a}. {5}, fy}, {3}, (a, Bi, {a v}s fm 5}, ts vd, (8, 83, fy, 3}, 


; 1a, B, v}, {a, B, 5}, {a. vy, 5}, {B, vy, 3}, {a, B, v, 8}. 
1... 2, 


Problem Set 7.2 


1. (a) {0, 1, 2, 3, 4, 5, 6, 7, 8,9, 10} (b) {1, 2, 3, 4} 
(c) {0, 1,2,3,4} (d) C (e) {0} (f) ¢ 
(gs) {xE R| x < 10, x #0, 1, 2, 3, 4} 
(h) {(0, 1), (0, 2), ..., (0, 10), (1, 1), (1, 2), ...» (1, 10), 
(2, 1), (2, 2), ..., (2, 10), (3, 1), (3, 2), .... (3, 10), 
(4, 1), (4, 2), ..., (4, 10)}. 
2. (a) {0,1,2,..., 20} (b) {0, 1, 2, 3, 4, 7, 14, 21, 28, ...} 
(cc) {xE NI[3<x< 203 (d) {7,145 (© (4 Cf) ¢ (g) {0} 
(h) A (i) {1,2,3} Gj) {x E N| x < 20, x 4 7, 14 
(k) {x € N|x > 3, x not divisible by 7} 
() {(0, 1), (0, 2), ..., (0, 20), (1, 1), (1, 2), ..-, (I, 20), 
(2, 1), (2, 2), ..., (2, 20), (3, 1), (3, 2), ..-» (3, 20), 
(4, 1), (4, 2), ..., (4, 20)}. 
4. (a) {(<, B), (a, 8), («, 9), (6, 6), (P, 8), (8, 9), Cy, BD, Cv» 8), Cy ®)} 
(b) {(a, a), (a, y), (x, ©), (B, a), (Bs y), (B, e), (vy, =), Cy, ¥), Cy, ©} 
(c) {(f, «), (B, y), (B, £), (8, «), (8, v), (8, ©), (8, a), (6, y), (8, ©)}. 
5. (a) {x|x>7orx <0} (b) {x|x#}} (c) R 
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I, 


bs 


6. 
8. 


@ &l-l<x<l) © $ © f&lx>D. 


Problem Set 7.3 


(a) 
(c) 


(f) 
(i) 


(j) 


Reflexive (b) None 

Reflexive, symmetric, transitive, and hence an equivalence 
relation (d) Transitive (ce) Reflexive and transitive 
Symmetric (g) Transitive (h) Symmetric 

Reflexive, symmetric, transitive, and hence an equivalence 
relation 


Reflexive, symmetric, transitive, and hence an equivalence 
relation 


(k) Symmetric and transitive. 


Problem Set 7.4 


(a) 
(b) 
(c) 


(d) 


(a) 
(d) 
(a) 


4(a) 
4(e) 


. (b) and (c) are functions. 


(i) Not possible (ii) f(a) = f(b) = f(c) = f(d) = 1 

(iii) Not possible (iv) f(a) = 0, f(b) = 1,f(c) = 2, f(d) = 3 
(i) Not possible (ii) f(1) = 0, f(z) =f) = 1 

Giii) fUl) = 0, (2) = 2,3) = 3 (iv) Not possible 

(i) (0) =f) = 1,2) = 2, 3) = 3 

(i) f(0) = f(l) = 2, fQ) = f@B) = 3 

(ii) Not possible (iv) Not possible 

(i) f(x) = tanx (ii) /(x) = sinx 

(iii) f(x) = e (iv) f(x) = 3x 4+ 4. 

(—oo, —1] U [1, ©) (b) [—2,2] ©) {xE R|x 4 —1} 
R (ce) R (f) {0} U [I, o). 

C (b) {zE C|[z4O0} (c) C (d) C (e) C (ff) C. 
[0, 00) 4(b) [0,2] 4(c) {xE R| x1} Ad) [6, &) 
[—1/2, 1/2] 4(f) [0, 0) 


S(a) {fzE C|Imz=0,RezpO0} 5(b) {2E C| | z| =—1}} 
Sc) {(2E C|Imz=0} Sd) {fZE C] |z] = 1} 
Se) {zE C|Imz=0, Rez > 0} 5(f) C. 


(c) is one-one. None is onto. 
(a), (c), and (f) represent functions. 


Problem Set 1.5 
3. (a) InRdefinea« b=a 


(b) 


In R X R define (x), x,) ® (1, 4s) = (~ at, ee) 


(c) In Rdefine a « b = a — b + ab. 
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Problem Set 1.6 


6. 


Additive identity, additive inverses, and multiplicative inverses are 
not in N. 


Problem Set 1.7 


2. 


7. 


10. 


gof:x}> sin? x,-r<x<qn. fogis not defined since R(g) 
& Dif). If D(g) = [—/x, +r], then fo g is defined and 
fog: xt sin, —/n7 ox < yn. 

gof:xe 7(l + x), -l<x<l. fog is not defined since 
R(g) & D(f). If D(g) = [0, 1), then fo g is defined and 
fog:xhe1+x,0<x<1. 

(f + g(x) = sin x + x°; (f — g)(x) = sin x — >’; 

(fg)(x) = x® sin x. 

(f + g(x) = 14+ 4+ x5 (S — gx) = 14+  — VX; 

( fg)(x) = (1 + x*) Vx. 

No. 


Problem Set 2.7 


2. 


(a) A plane parallel to the xz-plane 

(b) A plane parallel to the xy-plane 

(c) A line passing through (1, 0, 0) and parallel to the line y == 2z 
in the yz-plane 

(d) A parabola in the plane y = —5; the axis of the parabola is a 
line parallel to the x-axis and passing through (0, —5, 0) 

(e) The projection of the rectangular hyperbolas yz = 1 anJ 
yz = —1 (lying in the yz-plane) on the plane through (2, 0, 0) 
parallel to the )'z-plane 

(f) The half space on that side of the yz-plane in which x < 0, and 
the yz-plane 

(g) x = y is the plane perpendicular to the xy-plane and containing 
the line y = x in the xy-plane; the required set of points is the 
union of the plane x = y and the half space on that side of this 
plane that contains the positive x-axis 

(h) The projection of the iine y = 2z (lying in the yz-plane) on the 
plane through (3, 0, 0) parallel to the yz-plane along with the 
half plane determined by this projection and containing the 
point (3, 1, 0). 

@) v3 () vi4 © vid (@) 3. 

(1, 2, 3), (—1, 2, 3), (—1, 11/2, 3), (1, 11/2, 3), (1, 2, 9/2), 


(—1, 2, 9/2), (—1, 11/2, 9/2), (Ly 11/2, 9/2); 37/2. 
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Problem Set 2.2 


1. (a) +/13; tan ® = 3/2,0 < 6 < 7/2 
(b) 4/10; tan® = —1/3, 3%/2 < @< 2x 
(c) 34/5; tan6=2,0<0< 7/2 
(d) +5; tan 9 = —2, 2/2 < @<t 
(e) +/2;0 = x/4 (f) 4/13; tan @ = —3/2, 3n/2 <0 < 2n 
(s) V17;tan® = -4,7/2<O0<% 
(h) 24/5; tan 9 — 1/2,n < 0 < 3zx/2. 
2. (a) V14 (b) 5 (©) vVi4 Gd) V2. 
3. (a) (6,—9) (b) (4,—4,.12) (©) (—33,-9) (d) (2, 17, 12) 
(e) 138+ 187 — 11k. 
4. (a2) 2+ (bd) —i+ 4 (©) —3i- Sf (d) Sit 3 -- 2k 
(c) @ tA (f) —é-b 3. 
5. (a) —u+2v (b) 34 — 20v | i2w (c) —w — Ilv+- 7 
(d) 34-+ 2v — 2w (ce) 4u + 12v — 9w (f) --2u — 25v + 15w. 
6. 1a) (2/V13, 3/13) 1(b) (3/10, —1//10) 1c) (V5, 2/+/5) 
Wd) (—1/v5,2/Vv5) We) E+ AivV2 WE) (i -- Wiv 3 
\(g) (-§+ 4pivi7_ Wh) (--28 - Al VS 
2a) (2/14, —1//14, 3/v14) 2(b) (3/5, 0, 4/5) 
Ac) Git G—W/IV14 Wd) (—i - 2 + 4h)/-V21. 
J. (a) (—1/ V2, —1/V¥2) (db) (3/2, 1/2) (©) (/-v’2, - 1/2). 
8. (a) (1, --1,2) (b) (2,3,1) © (4,—-2,1) @ (3, 2, 6) 
(e) (2, -4) (f) ©, 2). 
9. (a) A(1/2, 1/2), B(3/2, 7/2) (b) A(1/2, —1), B(—1/2, 1) 
(c) A(3/2, —1/2, 1), B(9/2, —3/2, 3) 
(d) A(3, 3, -5/2), BUI, 3, —3/2). 


Problem Set 2.3 


1. (a) 2 (b) —32 () -4 (d) 2 (e) 5 (ff) —4 
(g) —4 (h) 0. 
9. (a) WV5 (b) —32/V/1073 (c) —4/V65 (d) —1//442 
(e) 5/385 (f) —4/3vi4 (g) —4//42 (bh) 0. 
3. (a) 2/10 (b) —32/V37 (©) —4/V13 @) 1/13 
(e) S//ll (ff) -4/V6 (g) —4/V/14 (h) 0. 
4. (a) (1,1) (b) (64/29, —160/29) (c) (—4i — 3/5 
(d) (—38 + Sf/17 (e) (1/7, 3/7, 5/7) 
(f) (—8/21, 4/21, —16/21) (g) (4¢ — 4f — 4k)/3 (h) 0. 
5. (a) 3 (b) O (c) anyrealnumber (d) 2, 1. 
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Problem Set 2.4 


3. cosa = —2/s/17, cos B = 3/17, cos y = 2/V/17. 
4. r=u-+ «(v — uw), where a and » are the position vectors of the 
given points. 
I’ + mm' + nn’ 
Te er “(2 4- m3 + n*) me +m? +n)" 
8. cos-! (2/3), cos } (—2/3), cos-* (1/3). 
9, 2x + 3y + 6z = 35. 
10. 38 — 2j + 6k. 
11. (a) 7/4 (b) 7/2. 


Problem Set 3.7 


1. (a) (1,5, —1,12) (b) (16, - 100,2,—6) (c) (0, 0,0, 0) 
(d) (—3, 19, —12, 13) (e) (0, 6a - 2b, 3a + 36, 3a — 5b). 

2. Yes. 4. (a), (d), and (f) are vector spaces. 

6. (a), (d), and (f) are vector spaces. 

7. (a), (c), (d), and (f) are vector spaces. 


Problem Set 3.2 


4. (c), (g), and (i) are subspaces of Vj. 
5. (b), (d), and (¢) are subspaces of ?. 
6. (a), (b), (4), (e), and (f) are subspaces of 7%” (a, 5). 


Problem Set 3.3 


1. (a), (c), and (d) are in [S]. 2. (c) isin [S]. 
6. (a) xy-plane (b) xy-plane (c) V, (d) Vs. 


Problem Set 3.4 


5. (a) {(x1, %2) & V, | x1 = 0}; subspace of V; 
(b) {FE ¥7(—2, 2) | f) = f(—1) = 0}; subspace of & (—2, 2) 


© (re Z(-221 Hm fe) =O and J fo) = 1); not a 
subspace 
(dd) {p € F | p(x) = p(—>)}: subspace of . 
6. (a) {(2, 2), (4, 1), (1, 1), G, 0)}; subset 
(b) {(4, 3), (8, 6), (3/2, 1), (11/2, 4), @ + /2,% — 2), (5 + V2, 
 -+- 1)}; subset , 
(c) (5/2 — t, 11/3 — 22) [0 <t < 1}; subset 
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14. 


(d) 
(e) 


(f) 
(g) 
(h) 


(i) 


(d) 
(e) 


(b) 


(a) 
(b) 
(c) 
(d) 


(e) 
(a) 


(It is the line segment joining the points (3/2, 5/3) and (5/2, 
11/3).) 

{(2 + 31,3 + 42) | 1 < ¢ < 2))}; subset 

(It is the line segment joining the points (5, 7) and (8, 11).) 

{3 —4,7+20)|0<t < 1}; subset 

(It is the line segment joining the points (3, 7) and (2, 9).) 

{(x, 2) | x P 1/2}; subset 

{(x, y) | 2x + 3y = 17}; parallel 

{(x, y) | (x — 1)? + & — 5)? = 1); subset 

(It is the unit circle centred at (J, 5).) 

{(3%, + 2t, 4¢, + 5t,)|0 <t, << 1,1 < & < 2}; subset 

(It is the interior of the parallelogram PQRS, where the points 
P,Q, R, and S are (2, 5), (5, 9), (7, 14), and (4, 10), respec- 
tively, including the edges PS and OR.) 

{(t, 4) |0<t, < 1,2 < ty < 4}; subset 

(It is the rectangle with vertices (0, 2), (0, 4), (1, 4), (1, 2), and 
its interior.) 

¥,; subspace (1) V, ; subspace. 

{(l + #,2 + 21, 1) | ¢ a scalar}; parallel 

(It is the line through the point (1, 2,1) and parallel to the 
vector (1, 2, 0).) 

{(x, y, Zz) |x ty + z= 3}; parallel 

(it is the plane through the point (3, 1, —1) and parallel to the 
plane x + y+ z= 0.) 

{(l + a, —3 + 2a, 4+ 3a + 8) | «a, 6 scalars}; parallel 

(It is the plane through the point (1, —3, 4) and parallel to the 
plane 2x — y = 0.) 

{(a + 38, 2% + 8, 3x) | a, B scalars}; subspace 

V,; subspace (f) V,; subspace (g) B; subspace. 


n 
Base space : {(x,;, X2, ..., Xn) | fat a,x, = 0} 
Leader : B Cy, Hy a 0. 
Oy 


Base space : set of all constant functions Leader : x? 

Base space : set of all constant functions Leader : *"/2 
Base space : {ax + 8 | a, 8 scalars} Leader : —sin x 

Base space : {ax + 8 | «, B scalars} Leader: x4/12 + x3/3 
+ 3x°/2 

Base space: {f € & (0, 2) | f(t) = 0} Leader: x + 1. 


UMW={0} (+) U4+W={At+hlihe ¥’(—a, a), 
f, is odd and f, is even}; U + W = &'(—a,a) =U@ W. 
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Problem Set 3.5 
1. (a), (b), and (d) are x1. 
2. (a), (c), and (e) are LD. 
3. (a) and (c) are LI. 
4. (a) and (e) are LI 
11. (a) S (6) S (c) {(1, 1,2), (—3, 1,0). 1, -1,1)} @ S$ 
(e) {(1/2, 1/3, 1), (2, 3/4, —1/3)}. 
12. (a) {(1, 0, 0, 0), (1, 1,0, 0), (1,1,1, D} (b) S 
(c) {(1, 1, 1, 0), G, 2, 2, 1), (1, 1, 3, —2), (1, 1, 2, 1} 
(4) S (e) (1,2, 3,0), (-1, 7, 3, 3}. 
13. (a) S (b) {],x-+ x*, x — x*} 
(c) S (d) {x* —4,x + 2, x — 2}. 
14. (a) S (b) {sin? x, cos 2x} 
(c) {sin x,cos x} (d) {In x} (e) S. 
15. Ic) (1,2, —3) Ie) (C,0,0) 2a) (0,0, 1,1) 


2(c) (1,2, 6, —5) 2(e) (1, —1,1,—1) 3(b) 3x 3(d) x*/3 
4(b) 1 4(c) bin(x +1) 4(d) In x’. 


Problem Set 3.6 


~ 


PON APS 


12. 


(a) Nota basis ; {(1, 2, 3), (3, 1, 0)} 

(b) Not a basis ; {(1, 1, 1), (1, 2, 3)} 

(c) Nota basis ; {(0, 0, 1), (1, 0, 1), (1, —1, 19} 

(d) Basis (e) Nota basis; 8. 

(a) Basis (b) Basis (c) Notabusis (d) Basis 

(ec) Basis (f) Basis (g) Nota basis (h) Basis. 

(a) 2 (b) 2 () 3 (d) 3 (e) 2. 

(a) 4 (b) 4 () 2 @d) 4 €) 5S ff) 4 (ge) 3 (h) 3. 
{(3, —1, 2), (1, 0, 0), (1, 1, 0)}, (3, —1, 2), (0, 1, 1), (2, 1, 2)}. 
(a2) 1; {3,2,1)} (b) 3; {(I, 2, 3), (0, 1, 2), (1, —2, 3)}. 
(a) {1, x} (b) {(x — X9)*, (X — Xo)’, (% — Xo)", (X — Xo)" 
(c) See Problem 11 

(d) {(1, 0, —1, 3, 0), (0, 1, —1, 0, 0), (0, 0, 0, 7, 1} 

(e) {(x — Xo), (x — Xp)®, (X — %y)®, (X — Xo)*}. 

(a) —1/2, —1/2, 3/2 (b) —3/2, —5/2, 7/2 

(c) 4X, — Xa, $44 —- Xy + Xa, — 9%) + Xs 

() -~3~ a yt taate 

(ec) —21/4, 13/2, 47/12 (ff) 2,0, —1. 


-(a) --1,6,-—2 (b) —2,-1,3 © —I1,1,—1. 
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14. 
15. 


16. 
17. 


{(1, 0, 0, 0), (—S, 3 4, —6), (0, 0, l, 0), (0, 0, 0, 1)}. 


hs hi 
>> CriXis a Ae,X,. eeeg yy LapXs- 


2. 
A = {(1, 0, 0, 0), (0, 1, 0, 0)], B = [I, 1, 5, 2), (1, 2, 3, 0), 
(1, 1,1, 19). 


Problem Set 4.7 


2. 
3: 


4. 
5. 


(a’, (d), (f), (g), (h). (J), (k), (D, (n), (0), (p), and (q) are linear. 
(a) Yes; T(x, y) = (—x/3 + 5y/3, 4x/3 — 2y/3) 
(b) Yes ; 7(x, y) = (2y,y) (c) No 
(d) Yes; T(x, y, 7) = (y + 2, x/2 + 2y — 2/2, 2x — 2y + 22) 
(e) Yes ; Tay + aX + av? 4- a4x7) = (--ag + 2a,) + ax 
+ 3(a 9 — a,)x* 
(fF) Yes; Taq + ax + agx”? + agx® + ax") = —2ay -+ 3a, + 4ay 
(g) Yes; 7(x,y) = (x — iy,x — y — iy). 
T(x, y) = (0, » — 2). 


T(x, y) = zs yy). 


Problem Set 4.2 


I. 


Pe 


(a) V,;2 (b) (C1, 1,0), 0,1, D);2 © %w;3 dd) W;3 
(ec) Vs;3 (f) [(1, 1,1, 0), (0, 1, 1, 0), (0, 0, 1, 1]; 3 

(2) Vi;4 (h) {p € P| pO) =0} (i) {pE P| p(0) = 0} 
Gj) F? kk) vO!) @ €(, 2). 

(a) Vo;0 (b) Vy3s0 (ce) VY3O (d) V,;0 

() (1,—-11,));1 @) W390 (@) %es0 (hy) V,;0 
(i) Set of all constant polynomials ;1 (j) V,;0 

(k) V,;90 (1) Set of all constant functions ; 1. 

T(X1, Xg, Xg) = (4X, — 3X_ + Xs, 8x, — Ox, + 2xz, 0). 

T(X15 X25 Xs) = (% + Xs, Xg + 2X3, —4x, + 3x, + 2x;). 

(a): (a), (b), (c), (d), (f), (g), (h), (j), and (k) are one-one 

(b) : (a), (c), (4), (e), (g), (J), (k), and (1) are onto 


" (ce): (a), (c), (4), (g), (j), and (k) are one-one and onto. 


Problem Set 4.4 


1. 


All are nonsingular; 
R-"(X1, Xg, Xg) = (4%, + Xg — 3X5, 4x, — 4xy — 3X, 
—-Xy +. Xs + 2xs) 
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S—"(%1, Xa, Xa) = 47, + xg, 7x, + Tx_ + 2x,, —X;3) 
T "(X45 Xa, Xs) = $(—9x,, — 2x, — SX — 3X3, Sx, -+ 8x, + 3x4). 

2. (a) T+ (X1, X2) = (%,/o,, Xq/aq) 
(b) T~"(X1, Xa, X3) = (X, — Xe, X_ — Xg, X53) 
(c) T Mog + ax + ox?) = (a/3 — a, + 2%2/3) + (2a,/3 
+ x, — 2a,/3)x + (—ag/3 + a,/3)x?. 
Problem Set 4.6 


1, (a) (2S + 37): (x4, xg) > (7x, + 3x2, 6x, + 8x2) 
(b) (3S — 77) : (x1, x2) > (— x, — 7X2, 9x, 4- 12x,). 


2, (a) (S + T) : (%1, Xe, X3) > (2x, — 2x_ + Xy, 54, + Oxy | Hs, 
—X, + 2x) 


(b) (3S — 27) : (x;, %2, X3) R> (- 4x, -F 9x, + 3x3, — 5x, -- 12x, 
+ 3x3, —3x, + Xz) 


(C) (oS) * (1, Xe, X3) RR > (aX_ | 4X4, GX, + AXy, ~ aX, + 2s). 


3. 
ST 4 es 

(a) R + 28 3e, —e, e, te, fe, Se, }+ 2e, — 10¢e, 

(b) 2R + 5T Te, - 3e, + Se, 17e, — 2e, — 23e, le, — 2ey 
(c) S—T —@, —3e, + &. + Ses —2e, + es — Ses 
(d) R + S + 27 4e, == 2, + 2é€s Te, — 9e, 10e, + ey = Tes 
(e) aR + BS (x +8 + ye (a + 3y)e, (3a + B + 3y)e, 
+ +(a—B— vie +(—a-+ Bee + Ber + (4a— 7B 
+ Yes + (a — S5y)es — 2y)es 


7. (a) T(x, X02, Xs Hq) = (%y + Kas - Xr + Xa — Xa, Xa t Xe» 
—Xs + X.), 
S(X1, X25 Xs, Xq) = (%_ — Xe + Xa, %y + Xa + Xa + XH 
Xe + Xq, 2X3) 
(b) I(x,, Xe, Xg, x,) == (x, $+ Nes X1 -+ X3 + Xap —%Xe + x3) X3), 
S(x, Xg, Xg, X,) — (x, or 2X ea 4X5, 2X3 + 2X4) Xy + Xs — Xs 
x, + 2x3) 
(c) TX,, X25 Ng. Xq) = (Xa, Xa + Xs — Nes 201 + Xa» Xs + 6x4), 
S(X15 Nay Xs, XQ) = Oy + Xal2 + 3x2, —Ha/2 — %!2 + Hl? 
X_/2 + 3xq/2, 2x1 +°X, + %3/2) 


———s ae eee —— 


(d) T=S. 
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Problem Set 4.7 


1, (ST)(x15 Xa, Xs) = (Xa, Xa + Xp + %a)- 
2. (a) (ST), Xs) = (2x, + 2%3, 3x; + 3x5) 
(b)  (T'S)(x1, %) = (Sx, + 4%, 0) 
(c) S*(x1, %s) = (4x, 18x, + 16%x4) 
(d) (T*S)(xy, x3) = (Sx, + 42, 0). 
3. (a) (ST)(%1, Xa, Xs) = (4x, + 6x, + Xs, 2X) — 3X, + Xs; 
—2X, + 3x5 + Xs) 
(b) (TS)(x1, Xs, Xs) = (—3x, 4+ 2x_ — Xs, Ox, + 4xq + 10%, 
—Xy + Xs) 
(c) (S7S)(x1, Xg, Xy) = (Sx, + 4xq + Ll xg, —4x, + 2%, 
2X1; — 2X, + 2Xs) 


(d) (TST)(x,, X3, Xs) = (2x, + 21x, — Xs, 28x, + 6x, + 10Xs, 
—2x, + 3x, + 5). 


4, 
e) es es 
(a) ST 2e, iis es vs Tes —2e, mae Se, + 3Se; ey —— Ses + l4e, 
(b) RT 3e, + 2e, + 3e, —l2e, + 3e, -—3e, + Je, — 8e, 
==: 20e, 
(c) RST —20¢, + 3e, 95e, + 6e, 38e, + 6e, + Sle, 
(4d) RS + 7) 3e; + 4e, + 2e, —lle, + 2e, —22e, + 3e, 
— 19e, — 35e, 
(e) 7? €; — €, + 4e, —12e, — 3e, —3e, — 3e, + Te, 
+ 13e, 
(f) 7°ST 35e, + 22e, —lle, — 79e, 19e, — 28e, 
— Sde, + 133¢, + 37e, 


§. S(x,, Xg) = (%, — Xa, Xp — X;), T(%,, Xq) = (Xq, 5). 
9. (a), (b), (c) Range : V, ; kernel: V,; rank : 3; nullity : 0. 
14. (b) S,S, is idempotent if S,S, = S,S,; 5, + S, is idempotent if 
5,5, + 5,5, = 0 
(d) (x, Xa, Xs) = (*;, Xa, 0), S(x,, Xas Xs) at (0, 0, X,). 
15. (b) Yes;5 (c) Yes (d) No 
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(ec) Less than or equal to the minimum of the degrees of nilpotence 
of Sand 7; S + T is nilpotent. 


17, (BR) (LA AT)—“May + ax + ax? + o,x*) = Xq + ax + (ag — Ae, 
— 2Aa,)x* + (ay — Aa, — Ang + APay + BW#ay)x®. 


Problem Set 4.8 


iceemceiin’--cekas eoioaoe res ee rere eee ne ee ep ee ee eee, — 


Range Kernel Pre-image of (3, —1, 2) 


R V, V, (1, 2, 0) 
V, V, (23/7, 18/7, —2/7) 


V; V, (1, —7/9, 13/9) 
2, (b) ¢ (c) (8/7, —18/7,3) (d) (1, 3, 2) 
(e) (1, —1, 3, 0) + [0, —1, 1, 1). 
3. (a): (hb) 1 (Wi) x +E) (Gj) —x/2 (k) xcosec x 
(1) —(1 + x)e* + [1] 
(bt): (h) x (i) (2) 4+ 11) G) —U 4 x*)/2 
(k) x®cosec x (I) —(2 + 2x + x*)e~* + [ll]. 


Problem Set 4.9 


1. (a) 2y = (C+ ee? 
(b) y= 4% + 2c08x + (x— +) sin xx #0; y =O 
when x = 0 
(c) 3y = C(3x — 4)-#8 — x9(3x — 4)-54, x 4/3 
(4) y= Ce + Mia t+ pa tB4O;y=(C+xe 
ifB=—a« (ec) x=Cy+y 
(f) y= ce — 5 8 pp orya 4 ete 


ifp=0 (g) x=Ce ™ ” + tan ty—1 
(b) x= cetin y + ein Yre—siny cos’ y dy 
i) Q—)D)x= Qt IDiC—y+2mQ+)),y>1 
(Gj) x= Ccosy+siny (k) y(l +p*) = C —cosx 
.@ yl + x?) = C+ 3 In Cate) ED 
2. (a2) WC + sinh x) = ¥(1 + x") 
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(b) Y(Ce +442) =1 
(c) y(C + 2x) = e** 
(d) x(C — y*?)=e (e) x(Ccos y + sin y) = 1. 
3. (a) Lisyes (b) LI;no (c) LD; no (d) LD; no 
(ec) LD;no (f) LD;no (g) LI; yes (b) LI ; yes. 


Problem Set 5.1 


$s —-470 (~—-$# —4#7 
1. (a) | | (b) : 
Lt 4 L$ #8 
P21 27 --$ -1 -¥9 
2. (a) | | (b) | | . 
L2 0 1_} L 4° 4 323 


423 14 


[oO —-1 —1 —1 -—17 [oO l 0 1 07 
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2 
a, 
Ci Of + 1 14 
riowq 
| | (bd) 1 1 (c) | 1 —} O 
Li O_J 
1 | Lo olf 
0 07 ri 0 0 —I7 
[Soil 011 o| 
(Oo 1 04 10 01 —-1) 
Cri 0 074 r32 0 0 
1 1 0 1o--1 0 
(g) 
111 }0 oO -! 
100 14 (o1 0 Of 


Problem Set 5.2 


1. (a2) T:y> Vs, 
T(X15 Xes Xs, Xq) = CX, + OX 1 2x, + 3x4, %, + Xs — Xe 
x, + 2x,) 


(b) 


(b) 


T: 


Vy eo V3 


T(X1, Xq) Xa, %q) = (7X, + 2x, 4 L1x3 — 8x,, Llx, + 7x, + 22x, 


ae 
i: 


T: 


yo 


vy 
T 
T: 


— 19x,, 13x, + 8x, + 30x, — 23x,). 
Vs > Vy, T(x, X2; Xs) = (41, Xa Xs) 
Va —> Vs, T(X1, Xa X3) = (x + 2x_ -- 2X3, —%1 + Xe + 2X3; 
Xy + X_ ++ Xs) 
Vy —> Voy T(X1; Xa) Xs) = O(— 1 — 4x, + 6X5, 3x, + Ixy, 
—2x + Xs + 3x3). 


> Vag > Vey T(X1s Xx Xs) = (%1 — X%2 + 2X3, 3X1 + Xs) 
= V5 —> Vay TeX) Xq Xa) = (2%) + 8x, — 6X5, 2x, — 8x, 


+ 4x;) 


° Vy ro Vas T(x, Xa; Xs) ae (5x, =e 2Xs, —X, = 2X5). 
> V_ —> Vs, Tm, Xs) = (% + 2X9) Xg, —%1 + 3X4) 


V5 — Vs, T(x;; Xs) —= (2X tr X35 Xa» 3X as 3x,) 
V, > Vz, TUX, x,) = $(2x, + 4%, —*% — 2X, — 17x, + %;)- 


cos 6 sin 07] 


|. 
= 8 cos 6_]J 
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Problem Set 5.3 


9 4 137] - 1679 
1. (a) | {| (b) ; 
L129 —S5_} L--7 1 $_! 
-~ 8 67 --1 44 
2. (a) | { (b) | |. 
L19 —2_] L 0 5_] 
--16 10 -6 £87 Tis 1 19 129 
3. (a) —8 —28 —40 —16 | (b) | 2 28 38 18 
L-6 -4 4 -6] L1i9 8 6 53 
f- 2 -17 -15 —287 
(c) | 10 8 14 2 |. 
L-15 —4 —14 i 
~ 2 -7 -37 Ts 4 1 
4. (a) | 14 —26 —12 | (b) | 1 —§ | 
L. 6 9 5_J Li 8 --#. 
is — 7 
(c) 5 —t is 


—1 -—2 3 
6. 
0 —9 5 
L—l1 —4 —l1} 
T—1 -17 —33 14 
3 5 5 —4 
li 0 10 44 —6 
0 0 —14 —2 
1 0 0 0 36_] 
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07 


© 
coo > > ed 
© 


0 
1 


01 
0007 


1 0 0 


pe 


- 
an) 

—_—_- S&S © 

mm © 


0 0 
01000 0 
| 
001 LJ 


11. dim = 5. The matrices with respect to the ordered basis {sin x, 
cos x, sin x cos x, sin® x, cos? x} are 
(“3 -2 0 0 07] 


| 
'2 3 00 0 


(a) |0 O 3 4 —4 
| 0 0 —2 3 0 
Lv 0 20 32 
mito 0 01 


| 
|g 0 1 6 —2_J 


Problem Set 5.4 


1. (a) —1l (b) 9 (c) 3. 
2. (a) (2, 3, 3) (b) (8, 19, 7)7 (c) The matrix [—1] 
r 3 l 21 
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-2 1 394 
ro 7 
3. (a) AB= | |,BA=/]; 7 Il 6 
L6 19_J 
itl 8 I5_J 
I~ 5 5 67] 
—2 —l -3 
(b) BA = 
9 —8 21 
Lt Il 13 12_] 
(7-22 56 137] (~7 9 104 
(c) AB=| 3 5 7 Ba 3 3 2 
L3 9 44) L24 8 21_] 
(“3 11 24 12 204 
(4) AB = | | 
L7 15 24 28 36_| 
[— 3 2 1 4 57] 
24 ll 16 19 38 
(ec) BA= 


—-1 -1l +3 1 -!1 
L —6 0 -—-2 —4 ~10_J 


0 O7 (~—-2 —2:7] 
(f) AB= | |, BA = | ie 
{0 0_J lL —2s 2 _j 
Fo 1 il —24 [0 
4. (@) | | (e) | | (c) 
L1 0O_] L_0 1_J | 1/8 —a/p*_| 
fy +O 437 
d) i ” 4 (e) | 11 -! 
| -1 1 - 
L—B/ey If/y_l | 
L-%4 0 4 
10 3 Sq (“25 21 337 
5. (a) A? = 332),A4= 9 10 12 . 
{3 4 8_j L27 6 13_] 
[—124 59 967) 


At‘ =| 45 26 37 
L 66 53 87_J 
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i ike C 47, 19 18 73 567 


L671 427 19.) }§Le8 73 | 
-10 5 1074 - 35 60 g07 
(c) a =| —-§ 4-1 4 =| 20 3 -1 | 
1 5 45 504 L 20 340 355_] 
[125 520 5987] 
A= | —15 —54 —104 : 


i. 75 2455 2505) 


[a —26 7] [a 6p J (“2 O71 
6. (a) | b) | 1 ©) | | 
LB a+ 6 Lp x«—6_J LO B_] 
[~ « BY 
(d) | { , where « and 8 are arbitrary scalars. 
L—-B a_J 
m1 —$7 [yw -i1 . 
7. (a) | { (b) | | (c) Solution does not exist. 
LY fi L—-—@ 3-4 
T Ayes 0 eee 0 ~] T pyar 0 eve 0 ~ | 
| 
0 Aglte ove 0 0 srs eee 0 
On (0) 
{_ 0 0 eee Ann = 0 0 Ses Unrn_ 
rip, Oo .. O77 
O I/r, .. 0 
(c) : : it £08 = l, 2; roy A 
> = - 
| 
LO O. .. 1/Agt 


9. (a) Nilpotent; 4 (b) Nilpotent; 4 
(c) Nilpotent;3 (d) Not nilpotent. 
t—-a] Fe BV ft 07 


14. . P ’ | 1 — a? >t | l, 
6 sae ie oe) eS 
f~-—1 07 . : 
+ | | , where « and 8 are arbitrary scalars with 6 # 0. 
L 9 1 


-—5 50 -2t oo = = 22 —244 
16. (a) | | (b) | | (c) | | 
L—25 45) L—30 39) L—-24 46) 
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(~“—25 357 - 64 —707] 


(d) | | (e) | 
L. 35 —60_| L_—10 


[~ 4119 —2546 


(f) I. 
t_—25460 37217_] 


18. (a) x=I1,y=1 (b) x = 5/8, y = (a3 - bzx)/6*, 68 40 


(\) x —y = 4z = 2. 


ew —_— = fee oe eee 


| 
54_| 


I D, D, D; D, D, D, D, 
I I D, D, D, D D, D, D, 
D dD, i! D; D, D D, D, D, 
D, oD, OD, D, I D, D, D, D, 
D, D;, OO, I D, D, D, D, D, 
D, dD, OdDs D, D, D, I D, D; 
D, Ds 2D, D, D; I D, D, D, 
D dD, OD; D, D, D; D, D, I 
D, oD, dD, D, D, D, D; I D, 
Problem Set 5.5 


1, (a) Range : fd, —i, 1), (3, 7, 0), (2, 2, 1) at Vs, ’ kernel : Vy ’ 


rank : 3; nullity : 0 


(b) Range : [(1, 3), (—1, —2)] = Vy; kernel: [(—1, 1, 1)]; rank: 


2; nullity : 1 


(c) Range: [(2, 7, 3), (0,1, —-1), (1,2, 1)] = V,; kernel. V,; 
rank : 3; nullity : 0 
(d) Range: [((2, 0,1, 2), (1, —1,2,0), (2,2, 4,3), (0,1, 3, 0)] 


== V,; kernel : [(—15, t, 9, 9, —12)] ; rank : 4; nullity: 1 


(e) Range : {(1, 2, I, 0), (—1, 3, es 


0), (1, —i, 2, 1), 


(0, 1, 0, 1)J 


(f) 


= V,; kernel: V,; rank: 4; nullity: 0 
Range: [(—1, 3, 2), (1, 1,2), (1, -1, D] = V5; kernel: V,; 
rank : 3; nullity : 0. 
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¢ 


- 2 00 
ro — 
2. (a) 4 | 1 a| ~4 20 
Ll : 
| § —4 1_I 
de 
(c) 7 3-1 s 
| 3 -l 34 
- 7-13 8 9m mi -1 0 OF 
3 9 O i —-l Oo 
(d) %& (ce) 3 
—4: § 42 0 O Pf 
(1 2 0 -8 64 10 0 2-24 
[" a% --o8 = Bq 
3. a + B* # 0; Se BRB | 
L_—«B RP a? | 
Problem Set 5.6 
‘- — | 37 rT 4] 37] [2 771 
2a) 12 | 1} @), 0 -1 (c) , —3 0 
13 2 —24 we. 2 L 5 4) 
Pa -ek 15 
a 7 
d) | -1 1-3 (&) | 
a | . 8 4-4) 
11-3 84 
ey ee ee | ae ae ae r2 2274 
(f) | { (g) | { (h) | 
17 0 44] L—2 101 (2 -1 4] 
P2317 
(i) | |. 
LO —1 54 
Fi+ti 2-i7 
Pleat 14471 | 
5. (a) | | (b) | 2438 1-4 
(347% 2+i_J 
Ll—-i 34214 
r2—-3§ 1+2 3-497 
C 
e L24+i 2425 2-G J 
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cok 2481-7 
(d) | l+i —i 2-3 
L—1 — 2 é 3—2i_]) 
6. ax® + by* + c2z* + 2hxy + 2fyz + Agzx, 
9, (b) A diagonal matrix. 


Problem Set 5.7 
m1 0 34 m1 0-1 —19 


1 @ [or 4] 01 3 2 


L0 0 04 L090 0 0] 


“1 00 07 
~!o0o10 37 


0100 
(c) ie be 
001 0 
10001 0 
(00014 
Tl! 9 007 [1 0 07 
-! 00 —29 | 
0100 01 0 
(e) (ff) |O 1 0 #17] @) 
001 0 (00 1 
LO 01 —3_J | 
L000 1] (0 0 0 
ri00 — 3 C100 274 
‘ 010 . 0 | 
1 
001 -% | 1 
L000 0O- L000 OJ 
2. (a) 2 (b) 2 () 3 (ad) 4 (ce) 4 (ff) 3 (g) 3 
(h) 3 (i) 3. 


3. Same as the answer to Problem 2. 
~- 1-5 1 a] 
4 1-3 -1 
—-3 1.1 4 —!1 
tt 16 -6 —9_} 


4. (d) Nonsingular; 4 
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~— 3 3 -—3 37] 
73 -5 4 
—~1 0 2 -I1 
Ll 53 —4 2_] 
5. (a) x = 14/19, y = 3/19, z = 13/19 
(b) x= 7/4,y = 1/2,z = —5/4 
(c) x= 1/9, y = —2/9,z = —1/3 
(I) x=S/7,y = 1,2 = 3/7 
(e:) x = 8/5,y = 5,2 = 9/5. 
1. ky = 2,k, = 4, k, = 6,k, =8,k, = 9,k, = 10. 


Problem Set 5.8 


(ce) Nonsingular; 


1. (a) Consistent; x, = 5/16, x, = 1/16, x, = 3/16, x = 1/8 

(b) Consistent; x, = 2, x, = 1, x, = 0, x, = 0 

(c) Consistent; (1, 0, 0, 0, 0) + [(0, —4, 1, 1,0), (0, 3, —1, 0, 1] 
(d) Consistent; (1, 0, 1,0) + ((—2, 1, 0, 0), (0,0, —2, 1)] 

(ec) Notconsistent  (f) Not consistent 

(g) Consistent; }(2, 1, 1, 0) + [(2, —8, —5, 9)] 

(h) Consistent; x, = 7/6, x, = 41 /6, x, = 1/3, x, = —59/6 

(i) Notconsistent  (j) Not consistent 

(k) Consistent; x, = x, = 2, x; = 0 

(1) Consistent; x, = —x, = 1, x, = 0 
(m) Consistent; (7, 6, 14, 3, 0) + [(0, 14, 14, 1,1), (7, —1, 12, 3, 4)] 
(n) Consistent; (1, —2, 0, 0) + [(—4, 7, 26, 1)]. 


Problem Set 5.9 
- 7 -3 —-8) 
1. (a) Nonsingular; : 3-1 —4 
L_—7 3 10_) 
["-—3 17] 
(c) Nonsingular; q | 1 —3 | 
10 —2 —2_] 


318 | ANSWERS TO PROBLEMS 


fi 16 7 

—6 ] 

(ec) Nonsingular; 35 : 
L_—7 6 

[(~-3 -1l 

(f) Nonsingular; : 5 3 
L-4 -4 


A 
4 -1 
5 6 
—5 23) 
27) 
af 

| 
4_| 


2. Same as the answer to Problem 2 of Problem Set 5.5. 
3. Same as the answer 10 Problem 4 of Problem Set 5.7. 


Problem Set 6.1 


1. (a) Even (b) Odd (c) Odd (d) Odd. 
2. (a) Even: (1, 2, 3), (2,3, 1), (3, 1.2) 
Odd : (1, 3, 2), (2,1, 3), (3, 2, 1) 


(b) Even: (1, 2, 3, 4), (1, 3, 4, 2), 
(2, 3, 1, 4), (2, 4, 3, 1), 
(3, 4, l, 2)» (4, 2, l, 3), 
Odd : (1, 2, 4, 3), (1, 3, 2, 4), 
(2, 3, 4, 1), (2, 4, l, 3), 
(3,4, 2,1), (4, 2, 3, 1), 
3. (a) 6 (b) 10. 


ad, 4, 2, 3), 
(3, 2, 4, 1), 
(4, 3, 2, 1), 
(1,4, 3, 2), 
(3, 2, 1, 4), 
(4, 3, 1, 2), 


(a) (x — yy — zz — x) (b) (x — yy — 2X(z — x) 


(c) a + B + c®? — Babe. 
Problem Set 6.4 


1. 7 


3. (a) —20 (b) —4 (c) 6 (d) 6 (e) 500 (f) 90. 


X%, Xg Xe «9 Xp 


Nw x Xs eee Xan-] 


n 
6. in-a Xn Xe Xa] = = (X%y + Xyey + XE + 2. + x,077), 
i= 


Xs Xy XxX eos x 


where o,, « , ..., 0, are 2 n-th roots of unity. 
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ial + y? + 2 x y 2 1 
xP 4+ VE+Z2 x yy 2 


7. (b) Ixttt+yt tet om ye % \-° 
xetyi + 22 X3 Ys 2s ' 
| 


\x2 + v2 + 2, XX y4 24 1 
8. x=0, -—a—b—-e. 


[ 2 0 07 [—l 1 —17 


ro —27 | 
10. (a) | | (b) | —4 20; @ 3 -l | 
ae qe | 
L 5 —4 lL tL 3 —~l 3_] 
po 13-8 --974 1 —2 2 0 OF 
| 
, 3 -9 O —3 _ 0 -2 2 «0 
(d) (e) 


[--2 —-10 8 -6_] L 0 0-4 4 
Problem Set 6.5 


2. Same as the answer to Problem | of Problem Set 5.5. 
4. Same as the answers to Problems 1 and 2 of Problem Set 3.5. 
5. Same as the answer to Problem 2 of Problem Set 5.5. 


Problem Set 6.6 
5. 0. 


Problem Set 6.7 


lL (a) x=—l,y=4 (b) x= S/N, y = —S/1 ° 
(c) x - ~2,y= 29/2,.2 = —8 (d) x = ~—1/2,y = 5/2,z = 2 
(e) x = 25/2,y = -17/2,z2 = —1/2. 

2. (a) x, = 5/16, x, = 1/16, x, = 3/16, x, = 1/8 
(b) x, = 2x, = 2,x,3 =x, = 0 
(h) x, = 7/6, x, = 41/6, x3 = 1/3, x, = —59/6. 

3. Inverses of the coefficient matrices : 


[-—1 —1 iT 


4 5 -2 


[ 2 -1 4s] 
(a) | | (b) xr | () 
5 31 L—-1 2_) 
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r—-1 $$ -17 ie oe 
@ | 0 —} 1] © | 0 —3 |. 
‘oe a a oe L 1 -$ oO 


The solutions are the same as those of Problem 1. 
4. x’ =xcosa+ysing, y’ = —xsina + y cos «. 


Problem Set 6.8 


1. (a) 0,5; K, = (1, —3)], Ky = [(1, 2)] 

(b) i, —i; Ki = (@, 1), Ka = ((—4, 1) 

(c) —3,2; K-,= [(!, —1)], K. = [G, 2)] 

(d) —1,—1,8; K_, = [{(1, —2, 0), (0, —2, 1)], K, = [(2, 1, 2)} 

(ec) 1, 1,0; K, = [(0, 1, 2)], Ky = [(0, 0, 1)) 

(f) —i, —i, 2i; K_. = [(1,0, —1), (0. 1, —1)], Ky = [U, 1, DJ 

(g) —1,4,1,3;K.i= ((1, 0, —4, 0)], Ky. = ((—8, 6, 8, —3)], 
K, = ((—3, 2, 2, 0)], K, = [(1, 0, 0, 0)]. 


ri 04 -—3 07 
2. 1(b) | | ic) | | 
{Oo —i_J | O 2.) 
r—-1 00 07 
0+0 0 
1(g) 
001 0 
L000 3 
1 0 0 07 
| 
‘ot 0 0 
3, at — 1; 
; )0 0 -1 0 
LO 0 0 —I1_j 
Problem Set 6.9 


2. (a) Ce (b) C (c) —4/[i—x*| (d) —2]x]?, 
where C is an arbitrary constant. 

3. 0. 

Problem Set 6.10 


1. (a) 46+ j—S5k (6) 4— T+ 2k (© (-3,1, —7) 
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(d) (1,5, —3). 

4,uxv=0. 

5. (a) No (b) Yes (c) Yes. 

6. (a) 8x +4y—z=19 (b+) y—-z+1=0 (c) &x — 7z = ll. 

8. (a -bxd)ce—(a-bxcldor(a-¢ x djb— (b 

9 


-¢ x dja. 
~ Wp/26. 
10. 3x —4y+2z2=ll1. 
Li. x/ll = y[2 = (3 — 22)/14. 
12. 4x + y+ 1lz = 39. 
13. 3x+ 4y 4+ 7z = 13. 
Problem Set 7.2 
M2 i ie, Ue, ey 
i. I(a) (C7 4/6’ ver | +/ 66 ’ 66” 1/66 )s 
1 l 3 
1(b) {(1, 0, 0), ©, as DO — Jor a?) 
s YL tyctle 2, een, Le 
5 1 
eet ———> | — ee , 0 e 
(7% — y} 
»ood 1 35 2419 
2. 2(b) Aye — 4/6’ vs 0), = 30° / 30° /30° )» 


( A2 0 — =e a eo 0, aoa che ay 

a/ 205 ae /205 +41 /4i /4!l 
2 

214) ((0,0,1,0 (Se Fe % Ze 


ie: 17 «46 109) 
14286 14286" '4/14286 — 


1s ~ 5 1 
3. 3(a) (ea ve, 7 ar © 


4° 


5 I J 
- - x + * + a7} 
54/7 eM 3/35 2), 


(47 — 42(x* + x°))}. 


Fics 
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5. (a) 0 (b) 0. 


8. If v, is the first vector in the span of the earlier ones, then the 
corresponding vector in the process of orthogonalisation will be zero. 


Problem Set 7.3 
6. Yes. 


Problem Set 7.4 


(“6 0 07 ~18 0 07 ("7 0 0°71 
I 
1. (a) 060] 6), 090) @ (0 v7 0 
| | 
{09 0 3} L 0 O 4_] [_O 0 —4 7_] 
2. (a) 4x? — 9y? = 36 or —9x? + 4y2 = 36 
(b) 9a? - 4)? ~ 36 or — 4x? | Oy? = 36 
(c) 9x° + 4y? =: 36 or 4x2 + Oy? = 36. 
Problem Set Af 
1. (a) yp  Cye® + Cyxe ® (b) y = C, cos 2x + C, sin 2x 
(c) yp- Cy + C, cosa + Cysina (d) y=- Ce" 4 Ce 
(e) y = C,et + e 72(C, cos (y 3x,2) 1 C, sin (3 ee 
(Py y- Cye* + Cet (g) yo Ce eevee y vas 
(h) Jy z Ce" + Coxe + Cye - 
(i) vr- Cy 4 Cav a Cye™ | Cye & 


Gj) po CG, $ Cre*™ 4 Cre 

(k) y = ((Cy + C,¥) cos (y 7x) 4+ (Cy + C,x) sin (/7x))e-*™* 
(I) y» (Cy t Care” + (C, + Cyxde 

(m) y == (Cy -t C.xe’* + (Cs + Cyx)e? 

(n) y = Ce7G $/5)/2 im Cie— 3-V/5'3/2 

(o) y= Ce’? + Ce * + Cy, (p) y= Cy + (Co + Cyxde™. 


Problem Set A2 


1. (a) y == C, cos 2x + C, sin 2x — (x?/8) cos 2x + (x/16) sin 2x 


(b) 
(c) 


(e) 


y = Cye** + Cyxe** + (2x + Ne ?#/32 

y = C, cos 2x + C, sin 2x + (1/4) cos 2x In cos 2x 

+ (x/2) sin 2x (d) y = Cye*®* + Cye* + 3e*/2 

y = C, cos (x/2) + Ce sin (x/2) + sin (x/2) In (sec (x/2) 

-+- tan (x/2)) — 1 (f) y = C, cos x + C, sin x — (x/2) cosx 
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(g) y = Cre + C,xe* + x8e 27/6 

(h) y Ce? |- Cge *3 +4 (3x + LN)e-*/9 

GQ) y= C, + Cycos x + Cysin x — 2x + x°/3 
(Gj) y~—C, & Coe? + Cye = —cosx — (x/2) sin x 
(k) y — Ce + Cre” + Cye* + xe*/8 

(I) yp=C, + Cyet? + Cye * 4 Qver?/3. 


Problem Set A3 


1. (a) y= Ce¥ + Ce * — e/3 
(b) y= C,cos2x 1 C,sin 2x (4/4) cos 2x 


(c) y = (C, cos x + C,sin aje* 4 sete 


(d) y- c,e'~! eee C,e' “Pov2% | sinh x 

(ce) y= Cye® + Cyxet + Cre” | (2cosx + 2 sin x + 2xe* 
4- x9¢ * + 8)/8 

(f) p= C, + C,cos3v4t Cy sin 3x + W/I8 

(g) vy -= (C, cos (3x/2) + C, sin (y 3/2) e7 2 b+ Cye*? + C,e* 


e+2r—-S + le - 2x?) cosh x - (6x + x7) 


sinh x} 
(h) y -- Cy + C,cosx + C, sin X — X COs X 


: 2 x? , 107 
(i) yr Cyt Ox + Cye* + Cye * - 55 ~ 39 { 338 cos x 


27.—i, l 3 
— 469 sin x + 13 x cos 2x } % x sin x 
(j) y= Cy + Cer + Cye*? — x7/12 + x/36 + ‘5 608 Xx 
l ; ] —% 7 —2¢ es 2 4-22 
+ 5p sin x — i8 e* + 100 *° + 0 x“e 
(k) y= (C, cos (Vv 7x) + Cc. sin (v7x))e iad + axe 


— ; e~®* sin 3x. 
Problem Set A4 


1. (a) + (2x — 1)e* (db) z (2x + 3 + 2e*) 
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(c) 


—x/10 — 4x/25 — sin x + => cos x 


oo 
‘13° 
(3x + 2)e* — +(x — 2). 


26 


—e**/29  (b) a8 (sin 3x — 6x cos 3x) 
rat (sin 2x — 10 cos 2x)e* 
= _ (2 cos 2x + sin 2x) 


585 (250x* + 475x* — 1940x + 388)e* 


—e**cosx (g) aj (7x + 2)e"*  (h) 0 xe, 


Index 


Abel’s formula, 240 

addition function, 12 

additive inverse, 42 

associative operation, 19, 20, 134, 
167, 291 

auxiliary equation, 277 


Base space, 81 
basis, 95 
orthonormal, 262 
standard, 97, 161 
Bernoulli’s equation, 143 
binary operation, 17 


Cartesian product, 6 
central quadric, 267 
characteristic 
equation, 234 
polynomial, 234 
value, 234 
vector, 234 
circulant, 223 
coefficient matrix, 195 
cofactor, 216 
collinear vectors, 89 
column, |! 50 
rank, 187 
vector, 148 
commutative operation, 18, 20, 291 
complement, 5 
complementary function, 142, 276 
composition, 24, 133 
coordinate vector, 99 


coplanar vectors, 89 

Cramer's rule, 231 

cross product, 241 
direction of, 242 
properties of, 242 


DeMorgan’s theorem, 7 
derivative family, 285 
modified, 286 
determinant, 204 
expansion of, 204, 219 
minor, 224 
product of, 227, 228 
diagonalisation, 237, 270, 271 
differential equation, ordinary li- 
near, 141, 144, 276 
homogeneous, 276 
nonhomogeneous, 280 
differential operator, 109 
dimension, 96, 100, 101 
direct sum, 80 
directed line segment, 37 
direction cosines, 59 
distance between points, 36 
distributive operation, 21, 134, 167, 
291 
domain, 10 
dot product, 50 
properties of, 50 


Echelon form, 188 
eigenspace, 236 
eigenvalues, 234, 236 
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eigenvectors, 234, 236 

elementary row operation, 187 

equality in V,, 64 

equivalent system, 185 

Euclidean space, 258 

existence and uniqueness theorem, 
144, 239 

extension of a basis, 99 


Field, 20 
finite-dimensional, 96 
function(s), 10 
absolute vajue, 12 
addition of, 25 
constant, 12 
equal, 24 
linear, 31 
one-one, 14 
onto, 13 
pointwise sum of, 25 
polynomial, 12 
real-valued, 25 
scalar multiplication of, 26 
zero, 12 


Gram-Schmidt 
261, 274 
group, 21 
abelian, 21 
commutative, 21 
orthogonal, 265 
unitary, 265 


orthogonalisation, 


Homogeneous equation, 139 
hyperboloid of one sheet, 273 


Identity, 24 

function, 12 

map, 109, 115, 122 
image, 10 
indicial equation, 277 
infinite-dimensional, 96 
initial value problem, 143 
inner product, 50, 164, 258 


natural, 259 

space, 258 
intersection, 5 

of subspaces, 77 
inverse 

of element, 21 

of function, 29 

of linear transformation, 

123, 125 

of matrix, 167, 177, 200, 226 
inversion, 203 

matrix, 200 
invertible, 168 
isomorphic, 127 
isomorphism, 122, 127, 160 


122, 


Kernel of a linear transformation, 
114, 116, 139 
matrix, 176 
Kronecker delta, 152 


Leader, 81 
left-handed system, 34 
line 
equation of, 56 
in vector space, 89 
linear 
combination, 74 
finite, 74 
nontrivial, 86 
trivial, 86 
equation, system of, 195 
extension, ‘111 
operator, 107 
transformation, 107 
idempotent, 137 
natural matrix of, 156 
nilpotent, 137 
nonsingular, 122, 127, 135 
nullity of, 117 
product of, 134 
range of, 114, 116 
rank of, 117 
scalar multiple of, 129 


similar, 253 
sum of, 129 
variety, 81, 139 


linearly 


dependent, 87, 88, 93 
independent, 87, 88, 93 


Map, 10 


linear, 107, 155 
zero, 109, 115 


matrix, 149, 155 


addition of, 159 

adjoint, 222 

augmented, 195 

charactetistic equation of, 234 


characteristic polynomial of, 234 


characteristic value of, 234 
characteristic vector of, 234 
conjugate, 182 

diagonal, 181 


diagonalisation of, 237, 270, 271 


eigenvalue of, 234, 236 
eigenvector of, 234, 236 
entries of, 150 

equal, 155 

Hermitian, 182 
idempotent, 182, 229 
identity, 152 
involutory, 172, 230 
lower triangular, 182 
multiplication of, 164 
nilpotent, 171, 229 
nonsingular, 168 
nullity of, 176 
orthogonal, 264 
polynomial, 172 
product of, 164, 165 
proper value of, 234 
proper vector of, 234 
range of, 175 

rank of, 175, 188 
scalar, 182 

scalar multiple of, 159 
similar, 253 
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singular, 168 
skew-Hermitian, 182 
skew-symmetric, 182 
square, 155 
sub-, 224 
sum of, 159 
symmetric, 182 
transpose of, 180 
transposed conjugate of, 182 
unitary, 264 
upper triangular, 182 
zero, 153 

minor, 224 

multiplication function, 12 


Natural matrix, 156 
negative triple, 243 
nilpotence, degree of, 137, 171 
nonhomogeneous cquation, 281, 139 
nontrivial solution, 139 
norm, 259 
normal}, 141 
n-tuples. 64 

addition of, 64 
null set, 4 
null space, 114 
nullity, 117, 176 


One-one correspondence, 15 
onto, 13 

operational methods, 289 

operator equation, 138 

polynomial, 290, 292 

order, 150 

orthogonal set, 261 

orthogonalisation, 
261 

orthogonally similar, 266 


Gram-Schmidt, 


Parallel, 81 

particular integral, 14C, 280 
solution, 140, 276 

permutation 
even, 203 
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odd, 203 
perpendicular distance, 62 
plane 

equation of, 60, 245 

in a vector space, 89 

vectors, 40 

addition of, 41 
pointwise product, 27 

scalar multiplication, 26 

sum, 25 
polynomial, degree of, 12 
position vector, 40 
positive triple, 242 
pre-image, 13, 14] 
proper 

values, 234 

vectors, 234 


Quadric, 267 
tangent to, 267 


Range, 13, 114, 116, 175 
rank, 117, 175, 188 
column, 187 
row, 187 
rank-nullity theorem, 120 
reflection, 109 
relation, 8 
equivalence, 8, 128, 194 
reflexive, 8 
symmetric, 8 
transitive, 8 
right-handed system, 34 
ring. 23 
commutative, 23 
with identity, 23 
row, 150 
equivalent, 187 
operations, 187, 207, 209 
rank, 187 
-reduced echelon form, 188 
reduction, 188 
vector, 148 


Scalar, 63 
multiple, 26, 39, 42, 64, 129, 159 
multiplication, function, 12 
multiplication, properties of, 29, 
43 
product, 50 
projection, 53 
triple product, 244 
properties of, 244 
Schwarz inequality, 51, 260 
sequence, 13 
set(s), 1 
addition of, 78 
empty, 4 
equal, 3 
finite, 15 
infinite, 6 
null, 4 
of complex valued functions, 66 
of continuous functions, 66 
of infinite sequences, 124 
of linear transformations, 130 
of m X n matrices, 156 
of n-times differentiable func- 
tions, 66 
of n-tuples of complex num- 
bers, 68 
of n-tuples of real numbers, 64 
of plane vectors, 41 
of polynomials with complex co- 
efficients, 66 
of polynomials with real coeffi- 
cients, 12, 66 
of real-valued functions, 25, 66 
of space vectors, 41 
shortest distance, 246 
singleton, 4 
skew lines, 247 
space 
coordinates, 33 
vectors, 40 
addition of, 41 
span, 89 


stairs, 188 
steps, 188 
straight line 
in a plane, 57 
in space, 58 
vector equation of, 57 
submatrix, 224 
subset, 3 
proper, 4 
span of, 74 
subspace, 69 
nontrivial, 72 
trivial, 72 
superset, 3 
symmetric form, 57, 58, 61 


Target set, 10 

translate, 81 

translation function, i2, 109 
triangle inequality, 260 
trivial solution, 139, 196 


Undetermined coefficient, me- 
thod of, 285 

union, 5 

uniqueness, existence and, 144, 
195 

unitarily similar, 266 

unitary space, 258 


Variation of parameters, 280 
vector(s), 37, 64 
angle between, 48 
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column, 148 
components of, 46 
coordinates of, 99 
difference of, 44 
direction of, 41 

equal, 41 

free, 38 

initial point of, 33, 37 
length of, 37, 40 
magnitude of, 37, 40 
norm of, 259 
orthogonal, 52, 261 
parallel, 37 

plane, 40 

product, 241 
projection, 53, 261 
resolution of, 52 
row, 148 

scalar multiple of, 39, 42 
sum of, 39 

terminal point of, 33, 37 
unit, 37, 44 


vector space, 62 


complex, 62 
finite-dimensional, 96 
real, 62 


Wronskian, 238 


Zero vector 


in plane, 40 
in space, 40 
of vector space, 64 


Errata 


In place of 


page 3 
zz {| 2@z+2r 5=0 
... because X - J’... 
B -(...} 
s called ... 
caf PPX ve 


. Problems 4 and 5. 


.. Problem 4 are one-one 


and which onto. 

--- elements (x, y) ... 
... real numbers. 

ea Ad aay See 


[In all these four examples 
of groups the operation 
1s Commutative. 


+ (fo gyx) f(g(>)) 
= f(x") 


... by F(AR). 


f.t. == from top 
f.b. == from bottom 


Read as 


page 4 
zza+2z+2z -5=0 
. because x — xX... 

se Bf easy 

is called ... 

ae SUX > 8 oe 

--- Problems 3 and 4. 


... Problem 3 are one-one 
and which are onto. 


... elements x, yp... 
... Integers. 
ee See aay ae 


In all the examples of 
groups listed above the 
operation is commutative. 


. (fo g(x) = S(e(x)) 
= fix’) 


.. by F(A, R). 


... function x x*® + x + 1 ... function x > x? 


». function 1/2 sine ... 


+x+l 
.. function (1/2) sine ... 


teens 


Page 


Line 


In place of 


Read as 
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ot 

44 
48 
49 
31 
54 
83 
85 


92 
96 
97 
97 


131 


167 


6 f.t. 
13 f.t. 
1 f.b. 
4 fib. 
20 f.t. 
19 f.t. 
3 f.b. 
8 f.t 


3 f.b 
10 f.t. 


10 f.b. 


8 f.b. 
2 f.b. 
1 fit. 


Ai fit. 
22 ft. 


1 f.b, 


3 f.t. 


2nd row 
in Table 


4.2 


7, 8, ll, 


28 f.t. 


last entry 


of 2nd 
matrix 


3 f.t. 
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Take YE FV. 


) n,,} ae 


Vay Vip cosy Very SAY Vy sn, 
... EXIStS ANY NoONZero ... 


.. iS LI; otherwise ... 


The reverse in equality ... 


dim ¥’, - (xy-plane) 


T(On titans Fi aed 


+ a,u,) = 0 

(V1 + Ys 2 i 
1 oa € 
Sof 

- 

3 0"! 
BA = | | 

1 —1_J 


LN =y-l 
.. by w and —y, 

oO Ge te s.; 

.» (a,, Gy)... 

.. (or V4)... 

. follows 

oie Mens 

. in ¢ (0, 2). 


11, 1,8) - 140, 1,1)... 
. . because {%,, .... Vat o- 
Take v €& VP. 

Psy Bigs ctey Vase Vinee 

... CXIStS 2 DONZETO ... 


is 11; because 
otherwise ... 


The reverse inclusion ,.. 
dim V, => dim 
(xy-plane) + ... 


T(FniMavy ton + Ml) 
= 9 
(Yi + Yale: +... 
C), — 
(S97) 
2 
ry 
3 Oo 
BA = | 
L—1 —i_j 


ew! eee ee 


Page Line In place of Read as 

174 22 f.t. + x8. wee HT My ve 

181 4 f.t. .. and = 67, = B;,.. ... and Bj; = By, ... 

182 3 f.b. ... (AT -= (A ”)., w (4)T = (ATY 

187, 188 The 7 x 11 matrix on page 187 should be read after 
line 9 f.t. of page 188. 

190 1 f.b. Oar Bega Ogg yy Oy1 Oyq Ogg Ogg 

251 13 ft. = A(u, = == A(u;) = 

267 12 f.b. uAu=k uTAu == k, 
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